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To the Instructor 


This book is based upon the one-semester transitional course Princi- 
ples of Analysis taught at the College of the Holy Cross. Starting from 
axioms for the real numbers, the book develops the integral and dif- 
ferential calculus of one real variable, culminating with a construction 
of exponential and circular functions via integration and power series. 
Familiar properties of these functions are established from their char- 
acterizing differential equations. 

The target readership is sophomore-level mathematics majors. The 
prerequisites are modest: a year of calculus, the ability to read actively, 
and a capacity for abstract reasoning. 


Students can easily find their first exposure to analysis to be a 
blizzard of complicated and unfamiliar definitions, bewildering idioms, 
and esoteric-sounding consequences stated as tone poems written from 
Greek alphabet soup. Indeed, basic analysis is a language course as 
much as a mathematics course. When this fact is not explicitly ac- 
knowledged, students are unnecessarily burdened with a mysterious 
layer of frustration: Students who enjoyed calculus suddenly find their 
day-to-day understanding of mathematics has sharply decreased for no 
apparent reason. 

Of course, the definitions of analysis exist to clarify potentially 
murky (albeit familiar) notions involving infinitesimals and the infinite, 
and theorems have useful computational and analytic applications. The 
book takes special care to articulate and establish technical points that 
are glossed over or omitted from modern calculus courses, and to assist 
students’ absorption of analytic syntax and idioms by expressing con- 
clusions of theorems in multiple forms: formally, conceptually /verbally, 
and in practical terms of their mathematical consequences. 

The organization and expository style are in part responses to the 
modern calculus syllabus and the changing strengths of college students. 

Following an old suggestion of Knuth, computational notation for 


ill 
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estimates, a.k.a. interval arithmetic, is developed, and used where it 
seems to simplify “traditional” proofs. 

Though fairly strict logical development is maintained (and minor 
exceptions are clearly indicated), the material is not always separated 
traditionally into topics. For example, integration by parts is intro- 
duced as soon as the fundamental theorems are available, and is imme- 
diately used to establish Taylor’s Theorem. Power series are introduced 
early on as a class of functions generalizing polynomials. As continu- 
ity, integration, and differentiation are developed in turn, power series 
serve as a substantial family of examples to which new techniques may 
be applied. Continuity of functions is defined in terms of sequences, al- 
lowing the technical work on sequential limits to be used immediately. 
(As a fringe benefit, explicit mention of domain issues is deferred until 
the introduction of function limits.) 

Generally, the goals at each stage are: to assist students in translat- 
ing between the informal notions of calculus and the language of mod- 
ern analysis; to reach interesting, substantial examples and theorems as 
quickly as possible; to build useful tools for subsequent application; and 
to “push the envelope” of what can be proven using available resources. 

Major results are stated for ease of subsequent use rather than for 
maximum generality, and almost all are proven in the main body of the 
text. In rare cases that the proof of a “major result” (i.e., a theorem to 
be used subsequently) is relegated to the exercises, a parallel statement 
has been proven in the text in detail, so that students have a “work- 
ing example” they can modify. This expository strategy is somewhat 
contrary to the conventional wisdom of the author’s formative years, 
but smooths the learning experience while still requiring students to 
understand and absorb techniques of proof. 


Despite the “storyline” structure of the book, certain topics may 
be omitted without loss of continuity. The procedural definition and 
properties of integer powers are familiar, and the proofs merely provide 
“realistic” examples of mathematical induction. The topology of sets 
is referenced mostly in the exercises; the notions of isolated points and 
limit points are used in the discussion of function limits, but may be 
defined specifically for that purpose. The material on cardinality is not 
used elsewhere. The Gamma function and sine integral are extended 
applications of a variety of techniques, but not used subsequently. 

Modulo one’s pacing and selective omission, the entire book can be 
covered comfortably in one 13-week term. 
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To the Student 


Elementary analysis (i.e., calculus) studies functions of one real variable 
at arbitrarily small scales. The main idea is implicit in the concept of 
limits. In this book we define limits carefully enough to prove theorems, 
not merely to state intuitively plausible principles. 

Real analysis requires understanding of real numbers. You have 
undoubtedly been familiar with the number line for years. However, 
the number line holds unsuspected complexity. A few examples will 
illustrate the subtleties of the real numbers and of limits. These should 
convince you of the need to study the real numbers and limits carefully. 
They should also serve as useful conceptual reference points throughout 
the course. Each definition we introduce is geared toward examining 
and analyzing similar classes of phenomena. 


Is 0.99 = 1? 


The expression 0.99 stands for the real number whose decimal represen- 
tation consists of an infinite string of 9s. Most people find it intuitively 
obvious that 0.99 < 1, but there is a surprisingly wide split of intu- 
ition on which alternative holds: 0.99 < 1 or 0.99 = 1. This question 
gets at the nature of fractions and infinite decimals, but also of limits. 
To emphasize one’s typical state of ignorance after taking calculus, the 
discussion below uses quotation marks to surround familiar terms that 
require careful definition in this course. 

The number 0.99 is the “limit” of the “sequence” 0.9, 0.99, 0.999, 
0.9999, ..., in which “the pattern continues”. Successive terms get 
“closer and closer” to 1, but each term differs from 1 by a definite, 
positive amount. “In the limit”, is there a lingering positive difference, 
or is the difference 1 — 0.99 exactly equal to zero? 

This simple mathematical question has a well-defined answer. In 
other words, once we have carefully defined the concept of a “real num- 
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ber” and the concept of an “infinite decimal” (repeating or not), only 
one answer is logically consistent: The two are equal. One way to prove 
this is to write x = 0.99. Since multiplying by 10 shifts the decimal to 
the right one place, 102 = 9.99. Now subtract the first from the second 
to deduce that 9x = 9. 

Interestingly, some who doubt that 0.99 = 1 find it intuitively clear 
that the differences 1—0.9 = 0.1, 1—0.99 = 0.01, 1—0.999 = 0.001, ... 
do approach 0 (rather than approaching an infinitesimal positive limit). 
The intuitive difference may be that in the decimal expression 0.00, the 
“correct” digits accumulate, while in 0.99, “the last digit never carries” . 


Does \/2 Exist? 


By convention, the expression “\/2” stands for a positive real number 
whose square is equal to 2. Nowadays, every child “knows”, by asking 
their calculator, that “/2 = 1.414213562”. A moment’s reflection, 
however, reveals the falsity of this belief: Multiplying x = 1.414213562 
(or any finite decimal not representing an integer) by itself yields a finite 
decimal not representing an integer! For example, since the rightmost 
decimal of x is 2, the rightmost decimal of x? is 4, so x? is manifestly 
not exactly equal to 2. 

In fact, the Ancient Pythagoreans knew that “\/2 is irrational”. 
More correctly, in modern terms, the Pythagoreans proved the “con- 
trapositive”: If x = p/q is arational number (ratio of integers) in lowest 
terms, then x? 4 2. This inequality can be written as p* 4 2q’. 

Each of the integers p and q is either even (an integer multiple of 2) 
or odd (leaves a remainder of 1 on division by 2). The square of an odd 
integer is odd, while the square of an even integer is an integer multiple 
of four. We can prove p? 4 2q by considering cases in which p and q 
are either even or odd. 


p odd. If p is odd, then p” is odd. Since 2q? is even regardless of q, 
p? # 2q? in this case. 

p even. Since p/q is in lowest terms, q¢ is odd in this case. But p? is 
an integer multiple of 4, while g? is odd, so 2q? is not a multiple of 4. 
Again, p? # 2¢q. 

In all cases, p? # 2q?. We conclude that no rational number is a 
square root of 2. 


Using unique factorization of an integer into primes, we can give an 
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elegant argument that the only integers having a rational square root 
are already perfect squares (of integers). Let N be a positive integer. 
If x = p/q in lowest terms and if x? = N, then rearranging as above 
gives p? = Nq?. Now factor each side of this equation into primes. The 
prime factors of p? and gq? appear with even exponent, so every prime 
factor of N appears with even exponent. This means JN is a perfect 
square. 


Though there is no rational number whose square is exactly 2, it 
is possible to construct “better and better rational approximations” 
to V2 using simple arithmetic operations. The recursive rule 


qo 2 Ln 2\Gn Pn 2PnIn 


introduced in Example 6.71 generates successive terms 


3 577 
cee NE 11491568 ... 
m= 5=15, ee on 568..., 
17 : 665857 
alee ee a ~ 1.4142135623.... 
a2 1 66, %4 = 779830 = 


The numerators p, and denominators g, are growing “rapidly”, and 
the sequence formally approaches 00/00. However, the decimal approx- 
imations seem to be “approaching a limit”. If we call this limit x,., we 


expect that 
(m+ 5) 
Loo = Vootl =F Loo + — ]. 
2 Leo 


Algebra gives #2, = 2, or 4 = V2 (since certainly 7, 4 —V2). This 
formal argument leaves important questions unanswered: Just what 2s 
a real number, and on what basis does the preceding sequence have a 
limit? How are we to work with specific real numbers if we are unable 
to construct an approximating sequence of rationals? 

A more general argument will help motivate definitions to be made 
later. Consider the set A of positive real numbers x satisfying x? < 2. 
For example, 1 € A (the real number 1 satisfies 1? < 2) but 2 ¢ A (since 
2? £ 2). We will show that the set A is “bounded above”: There exists 
a real number M such that « < M for every positive real number x 
satisfying 2? < 2. (For example, we may take M = 2 or M = 1.5.) 

Due to a property of the real numbers, there exists a “least upper 
bound” of A, namely a real number ¢ that is (i) Greater than or equal 
to every number in A (i.e., is an upper bound of A) and (ii) Less than 
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or equal to every upper bound of A. We then argue that (? = 2 exactly: 
If ¢? < 2 then property (i) is false, while if ¢? > 2 then property (ii) is 
false. The third alternative, 0? = 2, is all that remains! 


Continuous Functions 


In calculus, you may have learned that a function f is “continuous” if 
the graph y = f(x) can be drawn without lifting your pencil from the 
paper, namely if the graph has no “holes”, “breaks”, or “jumps”. Un- 
fortunately, a procedural criterion is unsuitable for proving theorems, 
and in any case this heuristic does not perfectly capture the formal 
analytic definition. We’ll examine a few deficiencies in turn. 

First, the graph of a “continuous function” can have holes, breaks, 
and/or jumps if the domain of the function is not an interval. The 
signum function sgn(#) = x/|x|, defined for x 4 0, is continuous at each 
point of its domain. “Near” every positive real number x, the function 
is equal to 1, and “near” every negative number x, the function is —1. 
There is no discontinuity at 0 because 0 is not in the domain. 

Second, the graph of a continuous function may be impossible to 
draw at all because the “length” of the graph is infinite between ev- 
ery pair of points! This behavior is, in fact, typical for a continuous 
function. 

Third, a function may be continuous at some points of its domain 
and discontinuous at others. As a fairly extreme example, consider 


1/q if « = p/q in lowest terms, 
f(x) = iia at 
0 if x is irrational. 


The graph seems to consist entirely of “holes” and “jumps”. However, 


SZ —l 


this function manages to be continuous at every irrational number. A 
proof is outlined in the exercises. 
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A “better approximation” to the formal definition of continuity is 
the following principle: 


If f is continuous at x, then f(x’) can be made as close as 
we like to f(x) by taking 2’ sufficiently close to x. 


Indeed, the formal definition “merely” makes precise what is meant by 
“as close as we like” and “sufficiently close”. 


Properties of Continuous Functions 


The preceding criterion makes sense in the rational number system. 
Nonetheless, the rational number system is unsuitable as a foundation 
for analysis. To see why, we'll consider functions that are continuous 
at every point of an interval. 

In calculus, you learned that if a continuous function is defined on 
a closed, bounded interval, and if the graph is below the x axis at one 
endpoint and above the x axis at the other endpoint, then the graph 
of f touches the x axis at least once, the intermediate value theorem. 

You also learned that a continuous function defined on a closed, 
bounded interval achieves an absolute minimum value and an absolute 
maximum value, the so-called extreme value theorem. 

These theorems are among the most useful yet subtle properties of 
continuous functions (of a real variable) that we will establish. Consider 
two functions of a rational variable: 


p(x) =27—2 and f(r) = ior 0 aD. 


72 — 


The function p is a polynomial, and therefore (as we will prove) 
is continuous in its domain, the closed rational interval [0,2]. More 
remarkably, the function f is a quotient of non-zero (!) polynomials, 
and is therefore also continuous everywhere in the rational interval [0, 2], 
despite its appearance of having a vertical asymptote. 
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The graph of the polynomial p starts below the x axis and ends 
above, since p(0) = —2 < 0 < 2 = p(2). However, the graph of p does 
not touch the x axis, since p(x) 4 0 for all rational x. The intermediate 
value theorem fails in the rational universe. 

The extreme value theorem fails for f. Visually this is clear from 
the graph. In a bit more detail, let (x,,) be the rational sequence con- 
verging to \/2 that was defined earlier. Since «2 — 2 decreases to zero, 
f(%n) grows without bound. Consequently, f has no maximum. For 
similar reasons, f has no minimum. 

Your inclination may be to dismiss these phenomena: “Well, then, 
don’t try to use the rational numbers as the setting for calculus”. The 
problem is, in what setting are we to develop calculus, and how are we 
to prove, e.g., the Intermediate Value Theorem in this setting? 


Power Series 


Among the simplest functions in calculus are polynomials, which may 
be evaluated using nothing more that the four arithmetic operations: 


dg + a,x + dot” +--+ +a,2" = ao ala, + r[d2 4 eB Gee) || 


By definition, a polynomial has only finitely many summands. What if 
we relax this restriction? 

In calculus, you met power series, including Taylor series, and en- 
countered remarkable formulas such as 


1 
=ltaet¢ae? tarts tart... Jz] <1, 
Le 
tT _] 2 | ce | an ce ] 
pic ro ag ee gs x real, 
2 gt 8 a 
cosz =1— 5 io (—1) Ont x real, 
. ae tht 
sint=e-Tta a7 (-1 Gm x real. 


You learned that power series can be manipulated—added, subtracted, 
multiplied, differentiated, integrated, etc.—as if they were polynomi- 
als. You may even have seen seemingly-magical relationships, such as 
Euler’s formula , 


e” =cos@+isin86, 
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a striking identity with observable physical consequences. 

Close inspection reveals that evaluating a power series involves a 
limit (summing an infinite series), while differentiating or integrating 
entails a second limit (taking difference quotients, for example). The 
theorems guaranteeing that power series can be manipulated like poly- 
nomials boil down to the possibility of “exchanging” these limit opera- 
tions: performing them in either order and obtaining the same result: 


lim lim versus lim lim, for instance. 
h-0 n—- 00 noo h-0 


The Fundamental Theorems 


A functional equation y = f(x) may be interpreted as a relation of de- 
pendence of one quantity (the “dependent variable” y) on another (the 
“independent variable” x). Working purely formally, we can measure 
the “rate of change” of f by changing the input slightly and observing 
the resulting change in the output: y+ dy = f(a+dz). The “rate of 
change of y with respect to x” would be 

changeiny dy f(x+dz) — f(x) 


changeina dx dx 


Conversely, suppose dy/dz is known, and we want to find the total 
change in y as x runs between two specified bounds, say a and 6. Again 


formally, the “infinitesimal increment” of y is 
d 

°F de = f(et+dz) — f(z). 
dx 


Adding up these quantities, the sum formally telescopes, and we find 
Sum of dy = Sum of f(a + dz) — f(x) fora<a<b 

[f(a+ dx) — f(a)| + [f(a+2dz) — f(a+dz)| +... 

+ [f(b) — fo — da)| 

= f(b) — f(a) = Total change in y. 


i 


Unfortunately, a moment’s reflection reveals vexing snags: 'To get 
an exact value for the rate of change, we need dz to be infinitesimal, 
which for real numbers means “equal to 0”. But when dx = 0, the 
quotient dy/dzx is equal to 0/0, and thus fails to be defined. 

Similarly, the infinitesimal increments dy = f(x + dx) — f(x) are 
either zero (so their sum is zero), or not (so they are merely approxi- 
mate). Either way our formal calculations are suspect. 
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Analysis is the branch of mathematics that logically justifies our 
ability to have our cake (algebraically manipulate expressions that are 
formally infinitesimal) and eat it too (work only with real numbers). 
The fundamental idea is that of “arbitrarily close approximation” , cod- 
ified in the theory of limits. 

Differential and integral calculus are the formal rules and algorithms 
that allow us to calculate with infinitesimals as if they were real num- 
bers, ignoring the fact that no non-zero real number is infinitesimal. 


Summary 


Analysis can be difficult to absorb for many reasons. The familiar real 
number system must be examined carefully and put onto a firm logical, 
conceptual, and computational foundation. You must become fluent 
at manipulating inequalities, and must develop your intuition about 
intervals of numbers. 

The heuristic definitions of limits and continuity you saw in calculus 
supply only the barest guidance, and must be fundamentally supplanted 
in order to prove theorems. Geometric intuition must not be discarded 
entirely, but neither can it be relied upon for more than suggestions for 
setting up and establishing algebraic and analytic statements. 

Not only are the definitions in analysis genuinely complicated, but 
the gap between the definitions and the theorems is bridged with math- 
ematical idioms you have not seen before. You must become familiar 
with proofs that assume an infinite number of hypotheses, and/or that 
deduce an infinite number of conclusions. 

Finally, proofs of theorems in analysis typically involve more pieces, 
and more conceptual layers, than proofs in algebra. It’s easy to get 
lost in the thicket of details even as you wander the familiar paths of 
differential and integral calculus. 

Happily, you’ll soon start to see patterns and recognize landmarks. 
With practice, you’ll absorb the precise definition of a limit, and thereby 
attain a higher level of understanding of calculus. In time, you’ll con- 
fidently apply these ideas in novel situations. 
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Chapter 1 


Logic and Sets 


Mathematics encompasses a language for expressing quantitative and 
logical propositions, and computational tools for using known truths to 
deduce new ones. In order to read, understand, and write mathemat- 
ics successfully, you must become fluent with the terminology, syntax, 
and idioms of this language. This chapter merely sketches the bare 
essentials needed for the remainder of the book. 


1.1 Negation and Logical Connectives 


A statement is a sentence having a truth value, T (True) or F (False). 
Contact with the external world can be made via experience, but in 
mathematics true and false may be viewed as undefined terms. 


Example 1.1. —4 is an even integer. 

The decimal expansion of 7 is non-repeating and contains the string 
‘999999’. (True) 

2+2=5. (False) 


Example 1.2. Sentences that are not statements include “x is a pos- 
itive real number” (whose truth value depends on x), and “101° is a 
large number” (“large” has not been given a precise meaning). 


Conventionally, abstract statements are denoted P and Q. 


Not. The negation of a statement P is its logical opposite =P. You 
may regard the negation as P preceded by the clause “It is not the case 
that...”, but usually a more pleasant wording can be found. 


Example 1.3. P: 2+2=4. aP: 24244. 
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Let P and Q be statements. New statements can be constructed 
using the “logical connectives” and, or, and implies. 

And. The statement “P and Q” has its ordinary meaning: The 
compound statement is true provided both P and Q are true, and is 
false otherwise. 


Example 1.4. 2+2=4 and 0 <1. (True) 
2+2=5 and 0 <1. (False) 
2+2=5 and 1 <0. (False) 


Or. The statement “P or Q” always has the “inclusive” meaning 
in mathematics: P is true, or Q is true, or both. 


Example 1.5. 2+2=4or0< 1. (True) 
2+2=5o0r0<1. (True) 
2+2=5o0rl <0. (False) 


Implies. A statement of the form “If P then Q”, also read “P im- 
plies Q”, is called a logical implication and plays a central role in math- 
ematics. P is called the hypothesis of the implication, Q the conclusion. 

By definition, a logical implication is valid provided Q is true when- 
ever P is true. In other words, “P implies Q” is a valid deduction unless 
P is true and Q is false. 


Example 1.6. If 1 40, then 17 40. (True) 
If 1 40, then 1? = 0. (False) 
If 1 =0, then 0 = 0. (True) 
If 1 =0, then 17 = 0. (True) 


If “P implies Q” is valid, we think of Q as being deduced or derived 
from P. The definition of “valid implication” ensures that by starting 
with true hypotheses and making valid deductions, we obtain only true 
conclusions, not falsehoods. There are two noteworthy and potentially 
confusing consequences of this convention, however. 

First, it is valid (not logically erroneous) to deduce an arbitrary 
conclusion from a false hypothesis. An implication with false hypothesis 
is said to be vacuously true. Humorous examples abound: “If 1 = 0, 
then money grows on trees.” 

In particular, the third and fourth implications of the preceding 
example are vacuously true. It may be helpful to point out that in each 
case, we can give a proof. If 1 = 0, then subtracting this equation from 
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itself gives 0 = 0, which proves the third statement, while squaring 
gives 1? = 0? = 0, proving the fourth statement. 

Second, a valid implication need not connect causally related state- 
ments. The implication “If 0 = 0, then 2 is an even integer” is valid 
because both the hypothesis and conclusion are true, but is effectively 
a non sequitur; the conclusion does not “follow” from the hypothesis 
in any obvious sense. A valid implication does not, of itself, constitute 
a proof. In the example at hand, we know the implication is valid only 
because there exists a separate proof, consisting of implications whose 
validity can be checked directly. 

In these two senses, mathematicians are liberal in deeming an im- 
plication to be valid. Again, “validity” is the weakest criterion that 
excludes the act of drawing a false conclusion from a true hypothesis. 

In this book, and throughout mathematics in practice, valid deduc- 
tions do actually link causally related statements. Most implications 
involve classes of objects, and assert that every object satisfying some 
condition must also satisfy some other condition. 


Negation and Conjunctions 


If P and Q are statements, then the statement “P and Q” is false if at 
least one of P and Q is false. If someone assures you two statements are 
both true, only one has to be false for the assurance to be unfounded. 
Formally, the compound statements 


“(Pand@), — (>P) or (>Q) 


express the same logical condition. 

Analogously, if someone assures you at least one statement of two 
is true, then both must be false for the assurance to be unfounded. 
Formally, the compound statements 


“(Por Q), — (4P) and (-Q) 


express the same logical condition. 

Together, the two preceding relationships are known as De Morgan’s 
laws, after the 19th Century English logician A. De Morgan. Loosely, 
the conjunctions “and” and “or” are interchanged by negation, perhaps 
contrary to first impression. 

Consequently, the order of negation and a connective matters: 


Example 1.7. The integers 1 and 0 are not both zero. (True.) 
The integers 1 and 0 are both not zero. (False.) 
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1.2 Quantification 


To accommodate classes of objects in the framework of statements, we 
allow statements to contain variables standing for elements of a set, so 
long as each variable is “quantified”, accompanied by the phrase “for 
every” or “there exists”. The quantifiers are crucial; pay close attention 
to them while reading, and do not omit them when thinking and writing. 


Example 1.8. For every real number x, 0 < 1+ 27. (True) 
For every real number 2, 0 < 2”. (False) 
For every integer n, n? = 1. (False) 


The preceding “for every” statements involve universal quantifica- 
tion. Each statement encapsulates multiple statements. For example, 
the first statement of the preceding example encapsulates an infinite 
collection of statements, one for each real number. 


Example 1.9. There exists a real number x such that 0 < 1+ 2”. 
(True) 

There exists a real number x such that 0 < x”. (True) 

There exists an integer n such that n? = 1. (True) 

There exists a real number x such that x = x 4+ 1. (False) 


The preceding “there exists” statements involve existential quantifi- 
cation. Again, each encapsulates multiple statements. For example, the 
fourth expresses that at least one truism is found among the statements. 
The compound statement is false because every individual statement 
is false. 


Remark 1.10. The statements of the preceding examples contain only 
“bound” (i.e., quantified) variables. 

Sentences containing “free” or “unbound” variables (such as “n is 
an even integer” or “x?-++x2—2 = 0”) are not statements. However, sen- 
tences containing unbound variables play the useful role of conditions in 
mathematics, selecting objects (perhaps integers n or real numbers 2) 
for which the resulting statement is true. 

Many mathematical theorems take the universally quantified form 
“For every x satisfying P(x), condition Q(x) is true”. For stylistic 
variety, such statements may be worded as implications involving “ar- 
bitrary” values of variables. 


Example 1.11. If x is a real number such that x? + x — 2 = 0, then 
x =1lorz=-—2. (True) 
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If n is an integer, then there exist unique integers g and r such that 
n=4q+rand0<r <4. (True) 
If a, b, and c are positive integers, then a® + 6? 4 c?. (True) 


Quantifiers and Negation 


The universal quantifier “for every” may be viewed as an enhancement 
of the “and” conjunction: “For every integer n, the condition P(n) 
is true” means that the infinitely many statements P(0), P(1), 
P(-1), and so forth, are all true. 

The existential quantifier “there exists” may be viewed similarly as 
an enhancement of “or”: “There exists an integer n such that the con- 
dition P(n) is true” means that among the infinitely many statements 
P(0), P(1), P(-1), ..., at least one is true. 


Example 1.12. Logical negation “converts” a “for every” statement 
into a “there exists” statement of negations, and converts a “there 
exists” statement into a “for every” statement of negations: 
P: For every real number x, x? > 0. 
=P: There exists a real number x such that x? < 0. 


P: There exist real numbers x and y such that x? + y? = 1. 
=P: For all real numbers x and y, 77+ 4? £1. 


Remark 1.13. This type of linguistic transformation needs to become 
second nature. Particularly, a positive assertion regarding a class of 
objects can be disproved by finding a counterexample, but cannot be 
proved by finding an example. 


Remark 1.14. When the hypothesis of a logical implication contains a 
variable but no quantifier is explicitly present, the convention is to read 
“for every”. For example, “If x > 0 then x? > 0” should be read “For 
every real number 2, if 2 > 0 then x? > 0” (assuming context dictates 
x is a real number). 

If an implicitly-quantified statement is negated, the existential 
quantifier must be added explicitly: “There exists a real number x > 0 
such that x? < 0”. 

To avoid confusion, including your own, include logical quantifiers 
explicitly. This book makes a special effort to set a good example. 
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Implications, and Multiple Quantifiers 


Among the most subtle conditions in mathematics are those containing 
multiple quantifiers. Pay careful attention to the ordering of quantifiers 
in a single sentence. Changing the order of words and phrases can com- 
pletely change the meaning of a sentence. The fundamental definitions 
of analysis, such as Definition 4.7, are conditions whose meaning de- 
pends delicately on the precise wording. When you encounter multiply- 
quantified statements, slow down and read several times to ensure you 
thoroughly understand the dependencies implicit in the ordering. 


Example 1.15. For every real number z, there exists an integer N 
such that « < N. (True; every real number z is smaller than some 
integer N.) 

There exists an integer N such that for every real x, x < N. (False; 
there is no single integer N greater than every real number 7.) 


1.3. Truth Tables and Applications 


The logical operators (“not”, “and”, “or”, and “implies”) introduced 


above are neatly summarized by truth tables: 


P Q|/|-7P PandQ PorQ P implies Q 
P| +B T T T 
esl sek F T F 
|e F T T 
fs SB F F T 


Truth tables furnish a useful tool for studying sentences built of 
other statements and logical connectives. This section gives a few ap- 
plications. 

Logical Equivalence. Two statements P and Q are logically equiv- 
alent if each implies the other: P implies @ and Q implies P. For 
brevity, we may write P iff Q, “iff” being short for “if and only if”. A 
truth table calculation shows P and Q are equivalent precisely when 
they have the same truth value: 


P Q|PimpliesQ Q implies P | P iff Q 
ae T T T 
it of F a F 
> OE T F F 
F F T T T 
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The Converse. The implications “P implies Q” and “Q implies P” 
are said to be converse to each other. The preceding table shows these 
implications are not equivalent. 

The Contrapositive. The implications “P implies Q” and 
““Q implies =P” are said to be contrapositive to each other. An 
implication and its contrapositive are logically equivalent: 


P Q| P implies Q || =Q -=P | =Q implies —P 
aL’. <r T Fr oF T 
T F F T F F 
F T T Be one T 
F F T a. ae T 


This fact of logic should become second nature to you. Many implica- 
tions are easier to understand and prove in contrapositive form. 


Example 1.16. In each statement, x stands for a real number. Let 
P be the statement “xr? — 14 0” and Q be the statement “rx 4 1”. 

The implication P implies Q is true, but may require a few seconds’ 
thought to see. 

The converse implication, “If 2 4 1, then x? — 1 4 0” is an invalid 
deduction. The number x = —1 is a counterexample: It satisfies the 
converse hypothesis Q, but not the converse conclusion P. 

The contrapositive reads, “If x = 1, then x? — 1 = 0.” This impli- 
cation is obviously true, and on general grounds its truth implies the 
truth of P implies Q. 


Example 1.17. In each statement, x > 0 is a real number, and n is a 
positive integer. 

Direct implication: If x < 1/n for every n, then x = 0. 

Converse: If « = 0, then x < 1/n for every n. 

Contrapositive: If z > 0, then there exists an n such that 1/n < a. 

It turns out that all three statements are true. The second is easily 
seen, even though the conclusion consists of infinitely many statements: 
O20 01/2, 0-173 ete: 

The third statement is true, and not difficult to see; informally, 
1/k +0 as k > ov, so if x > 0, there is some positive integer n such 
that: 1/7. a. 

The direct implication is therefore true, since its contrapositive is 
true. However, the direct implication exhibits a new phenomenon: The 
hypothesis consists of infinitely many statements, x < 1, x < 1/2, 
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x < 1/8, etc., but no finite number of these statements implies the 
conclusion. Indeed, if we assume only finitely many inequalities of the 
form x < 1/n, there is a largest denominator, say NV, and our collection 
of inequalities is equivalent to the single inequality « < 1/N, which 
does not imply x = 0. 


1.4 Sets 


Modern mathematics is built on the concept of a “set”, a collection of 
“elements”. These primitive notions will serve in lieu of definitions. 

Abstract sets will be denoted with capital letters, such as A or B. 
Elements are normally denoted with lower case letters, such as a and b. 
We write a € A as shorthand for “a is an element of (the set) A”, and 
b ¢ A for the logical negation “b is not an element of A”. 


Definition 1.18. Let A and B be sets. We say A is a subset of B, 
written A C B, if x € A implies x € B, that is, if every element of A is 
an element of B. 

Two sets A and B are equal if A C B and B C A, namely if they 
have exactly the same elements: x € A if and only if x € B. 


Example 1.19. Let A be a set. For each element a in A, there is a 
singleton set {a} contained in A. Take care to distinguish a and {a}; 
a is an object, while {a} isa “package” that contains exactly one object. 


Example 1.20. There exists an empty set @ containing no elements. 
For all x, the clause x € @ is false. In particular, for every set A 
the logical implication “x € @ implies x € A” is vacuous (has false 
hypothesis). Consequently, @ C A is true for all A. 


Example 1.21. The symbol R denotes the set of real numbers, to 
be defined precisely in Chapter 2. The symbol Z denotes the set of 
integers, or whole numbers. 


In mathematics, we often want to restrict our attention to sets that 
are contained in a fixed set U, sometimes called a universe. Specific 
subsets of U are conveniently described using set-builder notation, in 
which elements are selected according to logical conditions formally 
known as a predicates. The expression {x in U: P(x)} is read “the set 
of all x in YU such that P(x)”. 
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To personify, if ¢ is a population whose elements are individuals, 
then a subset A of YU is a club or organization, and the predicate defin- 
ing A is a membership card. We screen individuals x for membership 
in A by checking whether or not x carries the membership card for A, 
namely whether or not P(x) is true. 


Example 1.22. The expression {x in Z : x = 2n for some n in Z} is 
the set of even integers. 


Remark 1.23. For brevity, we sometimes write, e.g., the set of even 
integers as {2n: n € Z}, read “the set of 2n such that n is an integer”. 
This way of writing a set is convenient, and the meaning is generally 
clear, but it isn’t technically proper grammar. To define a set formally, 
first give the universe, then specify the predicate. 


Sets and Logic 


Let U be a universe, and let A and B be subsets of U. The clauses 
x € Aand x € B may be viewed as predicates P and Q on elements 
of U. By definition, the logical implication “x € A implies x € B” 
corresponds to the set relation A C B. Logical negation, disjunction 
(or), and conjunction (and) similarly have natural interpretations in 
terms of A and B. 


The complement of A: Ao={xinu:«c¢ A}. 
The union of A and B: AUB={c@inUu:reAorzre Bh. 
The intersection of Aand B: ANB={zinUu:xe Aandze B}. 


A Venn diagram represents subsets of a universe U pictorially. The 
universe is depicted as a rectangle, and subsets are disks or, if necessary, 
more complicated shapes. The complement of A, or the union and 
intersection of two sets A and B, might be drawn as indicated: 


AC AUB ANB 


Definition 1.24. Let A and B be subsets of U. Their difference is 
defined tobe A\ B= {xin A: x1 ¢ B}=ANB*. 
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We say A and B are disjoint if AN B = ©, namely if A and B have 
no elements in common. 
The power set of A, Y(A), is the set of all subsets of A. 


Example 1.25. If A = {0,1} has two elements, the power set A(A) 
has four elements: Y(A) = {@, {0}, {1}, A}. The empty set and A 
itself are always subsets of A, a.k.a., elements of A(A), so a power set 
is never empty. For example, A(@) = {@} has a single element. 


Families of Sets 


Let J be a non-empty set (possibly a set containing infinitely many 
elements), and suppose we have a family of sets A;, one for each 7 in J, 
with each A; contained in some fixed universe U/. We denote the family 
of sets {A;};-7, and say the family is indexed by I. 


Definition 1.26. Let {Aj;}i-7 be a family of subsets of U/. We define 
the union and intersection of the family to be the following subsets 


of U: 
|) Ai = {2 inU: «x € A; for some i in J}, 
iel 
()4i = {2 inU: ax € A; for alli in I}. 
iel 


Remark 1.27. If I = {1,2,3,...,n}, a family of sets indexed by J is 
often denoted {A;}"_,, and the union and intersection are denoted 


i=l i=1 


iel iel 
Definition 1.28. Let N be the set of non-negative integers, and let 
{Ar}ren be a family of sets. We say {Az}icn is nested outward if 
Ax © Agi for every k in N. 

We say {Ax}een is nested inward if Ayy1 C Ax for every k in N. 


Exercises 


Exercise 1.1. Let A, B, and C be subsets of a universe UW, and let 
P,Q, and R be the clauses x € A, x € B, and x € C. Use truth tables 
to establish the indicated identities. 


(a) (AUB)UC = AU(BUC). 
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(b) (ANB)NC=AN(BNC). 
Exercise 1.2. Let A and B be subsets of U. 


(a) Prove A C B if and only if B® C A’, and illustrate with a Venn 
diagram. 


(b) How is part (a) related to contrapositives? 


Exercise 1.3. Let P and Q be arbitrary statements. Use a truth table 
to prove “P implies Q” is logically equivalent to “=P or Q”. 


Exercise 1.4. Let P, Q, and R be arbitrary statements. Use a truth 
table to prove the following pairs of statements are logically equivalent: 


(a) “a(P or Q)” and “4P and 7=Q”. 
( 
(c) “(P or Q) and R” and “(P and R) or (Q and R)”. 


) 
b) “a(P and Q)” and “aP or 7Q”. 
) 
(d) 


“(P and Q) or R” and “(P or R) and (Q or R)”. 


Exercise 1.5. Let A, B and C' be subsets of a universe /. As in 
Exercise 1.1, use truth tables to establish De Morgan’s laws (a) and (b) 
and the distributive laws (c) and (d). How is each part related to the 
corresponding part of the preceding exercise? 

(a) (A cS Aes 
(b Se AnD 


=(ANC)U(BNC). 


) (AUB) 
) (ANB) 
(c) (AUB)NC 
(4) (ANB)UC 


A = (AUC)N(BUC). 


Exercise 1.6. For each positive real number 1, let 
A, = (-r,r) ={zin R:-r<2<r}. 


“Simplify” the following sets, i.e., write each without using a union or 
intersection sign. It will be necessary to argue intuitively. 


(a) J 4-. (b) () Ar. 


r>0 r>0 
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Exercise 1.7. For each positive integer n, let 
A, = (—n,n) = {xin R: —n <x <n}. 


Simplify the following sets. 


(a) U An. (b) () An: 


n>0 n>0 


Exercise 1.8. For each positive integer n, let 


A, = (-2,4) ={xin R: -4 <2 < 4}. 


nin 


Simplify the following sets. 


(a) UJ An. (b) 1) An: 


n>0 n>0 


Exercise 1.9. Let {Az}zcn be a family of sets that is nested outward. 
If n € N, simplify the sets, and illustrate with a Venn diagram. 


Exercise 1.10. Let {A;},en be a family of sets. For each n in N, 
define 


B= dg, Cy (Ac 
k=0 k=0 
(a) Show that the family {B,,},cn is nested outward. 


(b) Show that the family {C,}nen is nested inward. 


Exercise 1.11. Let {A;}ic7 be a family of subsets of some set U, and 
assume B CU. State and prove De Morgan’s laws and the distributive 
laws in this setting. (See Exercise 1.5.) 
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Chapter 2 


Numbers 


In school you learned about “real numbers” and the “number line”. 
While geometric intuition is an invaluable guide, it’s not adequate as 
a logical foundation for limits, continuity, and calculus with the degree 
of logical care we need. 

The bare legal contract for the real number system is laid out below 
as a list of axioms. The remainder of the chapter is devoted to (mostly 
familiar) consequences of the algebraic and order axioms. Completeness 
is discussed in Chapter 3. 

The axioms for the real number system fall into three categories: 


Algebraic Properties. (A1l—A4., M1.-M4., D.) The algebraic 
axioms concern the operations of addition and multiplication: What 
properties each operation has (associativity, commutativity, existence 
of an identity element and inverses), and how the two operations inter- 
act (the distributive law). 


Order Properties. (O1.—O3.) These three axioms formalize the 
idea of one real number being “greater than” or “less than” another, 
and the fact that every pair of real numbers is “comparable”. Geomet- 
rically, the order axioms guarantee that the real number system can be 
visualized as a subset of a line. “Less than” means “lies to the left of”, 
and “greater than” means “lies to the right of”. 


Completeness. This axiom formalizes the geometric intuition that 
the real number system “has no gaps”, or that “any quantity that can be 
approximated by real numbers is itself a real number”. Geometrically, 
if A is a non-empty set on the number line, and if some point M lies 
to the right of every point of A, then there exists a leftmost point (i.e., 
smallest number) lying on or to the right of every element of A. 


13 
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2.1 Axioms for the Real Numbers 


Definition 2.1. The real number system consists of a non-empty set R, 
two binary operations, + and -, and a subset P of R (the set of “posi- 
tive” real numbers) satisfying the following thirteen axioms: 


Al. Addition is associative: For all x, y, z in R, x+(y+z) = (a+y)+<. 


A2. Additive identity: There exists a unique element 0 in R such that 
for allz in R,O0O+2=2+0=72. 


A38. Additive inverses: For every x in R, there exists a unique —x in R 
such that + + (—2x) = (-z) +2 =0. 


A4. Addition is commutative: For all z, y,in R,7+y=y+c. 
M1. Multiplication is associative: For all x, y, zin R, x-(y-z) = (x-y)-z. 


M2. Multiplicative identity: There exists a unique element 1 in R, dis- 
tinct from 0, such that for allz in R, 1-27 =a2-1l=z2. 


M3. Multiplicative inverses: For every non-zero x in R, there exists a 
unique z~! in R such that - 27! = a27!- x =1. 


M4. Multiplication is commutative: For all x, y, in R, x-y=y- 2. 


D. Multiplication (on the left) distributes over addition: For all x, y, 
zinR,z-(y+2)=(a-y)4+(a-2z). 


Ol. The law of trichotomy: For every real number x, exactly one of 
the following holds: x € P, —x € P, or x = 0. 


O2. Closure under addition: If x and y are in P, then x + y is in P. 
O3. Closure under multiplication: If x and y are in P, then x-y is in P. 


C. Completeness: If A is a non-empty subset of R that is bounded 
above, then A has a least upper bound in R. 


Remark 2.2. The multiplication dot is often omitted: x -y = xy. 


Remark 2.3. These axioms have minor redundancies built in for conve- 
nience. For example, if x+y = 0, then by the commutative Axiom A4., 
y +x = 0 as well; there is no need to assume both equations in A3. 
Further, the uniqueness conditions in the axioms for identity elements 
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and inverses can be deduced from the other axioms, see the proof of 
Lemma 2.14. 

In fact, the set of real numbers, including the operations of addition 
and multiplication and the set of positive numbers, can be constructed 
from a much smaller number of axioms. Our axioms above would then 
be proven as theorems. 


Auxiliary Concepts 


We define the operations of subtraction and division in terms of addition 
and multiplication. 


Definition 2.4. If x and y are real numbers, we define their difference 
to be x-—y=ax+(-y). 


If y 4 0, we define their quotient to be x/y = x-y7!. In particular, 
1 


l/y=y™. 
Remark 2.5. Subtraction and division are neither associative nor com- 
mutative, as you should check. 


We define the concepts of positive and negative numbers, and the 
relations greater-than and less-than, using Axioms O1.—O3. 


Definition 2.6. Let x, y and z be real numbers. 
If z € P, we say z is positive, or 0 is less than z, and write 0 < z. 
If y —x € P, we say x is less than y and write x < y. If x < y or 
x= y, we say x is less than or equal to y, and write x < y. 


Remark 2.7. If 0 < z, we also say z is greater than 0 and write z > 0. 
If x < y, we also say y is greater than x and write y > x. Ifa <y 
we also say y is greater than or equal to x and write y > x. 


Whole numbers and fractions constitute some of the most important 
classes of real numbers. 


Definition 2.8. The set N of natural numbers is the smallest subset 
of R satisfying the following conditions: (i) 0 € N; (ii) If « € N, then 
c£t+1eN. 

A real number z is an integer or whole number if either x or —x is 
a natural number. The set of integers is denoted Z, from the German 
Zahil. 

A real number z is a rational number if there exist integers p and q 
such that g > 0 and x = p/q. The set of rational numbers (a.k.a. ratios 
or quotients) is denoted Q. 

A real number x is irrational if x is not a rational number. 
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Remark 2.9. In this book, 0 is a natural number. The set of positive 
integers is denoted Zt. 


Remark 2.10. Though numbers encountered in practice are often ratio- 
nal, “most” real numbers are irrational in a precise technical sense, see 
Example 5.45, ff. We have already encountered V2 (p. vi). Other ex- 
amples include e (the base of the natural logarithms) and 27 (the period 
of the circular functions, a.k.a. the circumference of a unit circle). 


Remark 2.11. In mathematics, a field is a set F’ together with two 
arithmetic operations + and - that satisfy Axioms Al.—A4., M1.-M4., 
and D. An ordered field additionally satisfies Axioms O1.—O3. 

The field of real numbers is the starring example in analysis. The 
set of rational numbers is an ordered field as well (see below), and plays 
a strong supporting role. 

The set of integers is not a field; Axiom M3 fails. 

The set of complex numbers is a field, but not an ordered field. By 
Corollary 2.19 (ii) below, in an ordered field, if « 4 0, then x? € P. 
However, each of 1 and —1 is the square of some complex number, so 
the trichotomy axiom does not hold. 


2.2 Algebraic Properties 


Though the axioms for the real numbers are numerous, we must still 
establish properties you may find “obvious”. Doing so gives us a chance 
to see the axioms at work. 

We first collect a few useful consequences of Axioms Al.—D. These 
properties hold not only in the real number system, but in any setting 
where Axioms Al.—D. are true, such as in the rational number system. 


Lemma 2.12. Multiplication on the right distributes over addition: 
For allz, y, z inR, (y+ z)-2=(y-2) + (2-2). 


Proof. If x, y, and z are arbitrary real numbers, then 


(y+z)-e=a-(y+z2) Axiom M4., 
= (x-y) + (z-2) Axiom D., 
=(y-r)+(z-2) Axiom M4. 


Remark 2.13. Because of the commutativity axioms, any identity in- 
volving addition or multiplication on the left has a corresponding ver- 
sion with the operation on the right. 
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Lemma 2.14. Let x, y, and z be real numbers. 
(i) Ifaty=ax+z, theny=z. 
(ii) [fx #0 and sy = xz, theny =z. 


Proof. (i) Suppose x + y = x + z, and let —zx be the additive inverse 


of x. We have 
y=O+y Axiom A2., 
=((-2)+2)+y Axiom A3., 
= (-x)+ (x+y) Axiom A1., 
= (-—r) + (x+ z) Hypothesis, 
= ((-") +2) +2 Axiom A1., 
=O0+2 Axiom A38., 
27 Axiom A2. 


(ii) Mimic the proof of (i), replacing addition by multiplication and 


replacing the negative —zx by the reciprocal x7. 


Remark 2.15. These conclusions are called the “left cancellation laws”. 
There are corresponding “right cancellations laws”. For practice, state 
and prove these identities for yourself. 


Lemma 2.16. [fx € R, then —(—2) = 2. Ifx #0, then (x~!)"! =a, 
Lele) =e: 


Proof. The equation x+(—x) = 0 may be interpreted as saying that the 


(unique) additive inverse of —z is x itself, ie., —(—x) = x. Similarly, 


if c Z 0, the equation z(x~1) = 1 says (x-!)-! =a. 


Proposition 2.17. For all real numbers x and y: 
G) 0-2 =2-0 =) 


(ni) fay = 0) then a= 0-0r y=. 


(iv) (—x)(—y) = ay. Particularly, (—1)(-1) =1. 
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Proof. (i) Taking « = 0 in A2, we have 0 = 0+ 0. Now let x denote 
an arbitrary real number. Multiplying on the right by x and using the 
distributive law, we have 


0+(0-2)=(0-7) =(0+0)-r=(0-2)+ (0-2). 


By the cancellation law, 0 = 0-2. By the commutative Axiom M4., 
0 =2-0 as well. 
(ii) Suppose zy = 0. If x = 0, there is nothing to prove. If x 4 0, 


y = (2 'a)y = 2" (ay) = 20) = 0. 
(iii) Multiply 0 = (1+ (—1)) on the right by : 
z+ (—2) =0=0-2 = (1+ (-1))-¢@=1-¢4+(-1)-e¢=24+(-1)-2. 
By cancellation, —x = (—1)- a2. By commutativity, —2 = x - (—1). 


(iv) Taking « = —1 in (iii) and invoking Lemma 2.16, we have 
(—1)(-1) = —(-1) = 1. Thus 


2.3 Order Properties 


Mathematical inequalities are the bread and butter of analysis. The 
following rules for manipulating inequalities will be used continually. 
For example, (i) says that inequality is “transitive”: inequalities can be 
“daisy-chained”; (iii) says that multiplying an inequality by a positive 
number preserves the inequality. 
Theorem 2.18. For all real numbers x, y, and z: 

(i) Ifa<y andy < z, thenaz < z. 

(ii) Ifa<y, thnu+z<ytz. 
(iil) Apo ee yp and 0 <2 then ee = yz: 


(iv) day and 2 <0, then ye < we. 


(v) [f0<a<y, then0<1/y<1/z. 
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Two additional extensions are useful occasionally: 
Corollary 2.19. Let x, y, z, and w be real numbers. 
(i) Ifa<yandw <z, thnzt+tw<ytz. 


(i) JP O< oe < y ond 0 Sw < Zz; then 0 < mii ye: 
In particular, 0 < a+ x, with equality if and only if x = 0. 


Remark 2.20. In words, (i) says two inequalities can be “added”, pre- 
serving the sense of the inequality; (ii) expresses a similar guarantee 
when inequalities are multiplied, provided all quantities involved are 
positive. 


Remark 2.21. The set P of numbers mentioned by Axioms O1.—-O3. is 
uniquely characterized by these axioms. Specifically, P turns out to be 
precisely the set 


fy in R| y = 2” for some x 4 0} 


of squares of non-zero real numbers. Corollary 2.19 (ii) guarantees 
every non-zero square is positive. The reverse implication, that every 
positive real number is the square of some real number, will be proven 
in Chapter 6. 


To reduce the properties in Theorem 2.18 to Axioms O1.—O3., it is 
convenient first to establish special cases where one comparand is zero: 


Lemma 2.22. For all real numbers x and y, 
(i) [f0<2 andy <0, thenzy <0. 

(ii) Ifa <0 andy <0, then0 < ay. 

(in) Pee, then 0 < lia. 


Proof. (i) By trichotomy, y < 0 if and only if —y € P. By Axiom O38. 
and Proposition 2.17 (iii), —(#y) = x(—y) € P, ie., zy < 0. 

(ii) If —z and —y € P, then by Axiom O3. and Proposition 2.17 (iv), 
0 < (—2)(—y) = ay. 

(iii) By trichotomy, either 1 € P or —1 € P. Since P is closed under 
multiplication, either 1-1 = 1 is positive, or (—1)-(—1) = 1 is positive. 
Under either alternative, we conclude 1 is positive, or 0 < 1. 

Suppose 0 < a. If x7’ were negative, then by (i), we would have 
1 = x(x~') < 0, which we have just seen is false. Contrapositively, if 
Oe then. 02a 
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Proof of Theorem 2.18. (i) By definition, x < y if and only if y—2 € P, 
and y < z if and only if z —y € P. By Axiom O2., 


SEH Uae) ee 


which is equivalent to x7 < z. 

(ii) For all x, y, and z, we have y—x = (y+z)—(4+2z). The claim 
follows immediately. 

(iii) If < yand0 < z, then y—x € Pand z € P, so by Axiom O3., 
their product (y — x)z = yz — xz is in P, which means xz < yz. 

(iv) Since x < y and 0 < —z, part (iii) gives 


0< (y—2)(-z) = («@—y)z = 22 — yz, 
L€., YZ < “2. 


(v) By Lemma 2.22 (iii), if 0 < a < y, then 0 < 1/x and 0 < 1/y. 
Algebra gives 1/x — 1/y = (y — x)/(xy) > 0, ie., 1/y < 1/z. 


Proof of Corollary 2.19. (i) By Theorem 2.18 (ii), adding x to w < z 
and adding z tox <y givesxrt+w<x2+t+z<ytz. 

(ii) follows similarly from Theorem 2.18 (iii). 

For the assertion about real squares, it suffices to note that 0-0 = 0 
by Proposition 2.17 (i), while we have just shown that if « 4 0, then 
Ora: 


2.4 Exponentiation 


Definition 2.23. Let x be a non-zero real number. We define integer 
powers of x by 


ght] = okey oe 
if k is a natural number. 
—k _ /,.k\-1 
x = ee ) ) 


Example 2.24. Expanding the definition for 7 = 2, we have 


DF PD DS De Pn ae 
1 1 1 


(2") DP DQ 2a BD 
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Theorem 2.25 (The Law of Exponents). [fx 40, y £0 are real, then 


(ike aera ee for all integers m and n. 


In particular, x-" = (x~')” for all real x #0 and all integers n. 


Proof. Conceptually, these results amount to counting the number of 
factors in a product. For instance, 7”*” represents a product of (m+n) 
factors all equal to x; such a product can be separated into a product of 
m factors and a product of n factors, i.e., into 7-2”. For illustration 
we give formal proofs by induction. 


(Proof of (i)). For each natural number n, consider the statement 


P(n): (xy)" = (a")(y"). 


The base case P(0) reduces to 1 = 1, which is true. Assume inductively 
that P(k) is true for some k > 0. We have 


(xy)*** = (ay)* (ay) Definition of exponentiation, 
= (x*y*) (xy) Inductive hypothesis, 
= g*(y* -x)y Associativity, 
= x*(x-y")y Commutativity, 
= (a*- 2)(y* - y) Associativity, 


Definition of exponentiation. 


Since P(0) is true and P(k) implies P(k + 1) for all k > 0, the state- 
ment P(n) is true for all n > 0 by the principle of mathematical induc- 
tion. If n < 0, replace x and y by their multiplicative inverses. 

Taking y = x~!, we have 


Par aay Scie") 


by cancellation, (x~')" = x~” for all n. 


(Proof of (ii)). We first assume m and n are non-negative integers. 
For each n in N, consider the statement 


P(n) ge Se oa tor all min IN: 
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This single statement may be viewed as an infinite family of statements, 
one for each natural number m, with n a fixed natural number. 

The base case P(0) asserts xt = x™- x° for all m, which is true 
since m+ 0 =m for all m and x° = 1. Next, assume inductively that 
P(k) is true for some k, namely that 


m+k k 


x =z”. for allminN. 


For all m, we have 


gi thtl —_ ymtk . > Definition of exponentiation 
ai Cre rag es Inductive hypothesis 
See ea) Associativity 
= y™. ght Definition of exponentiation 


which establishes the inductive step. By the principle of mathematical 
induction, 2’*” = 2™- x” for all non-negative m and n. 

If m and n are both non-positive, conclusion (ii) of the theorem now 
follows immediately by replacing x with x7}. 

It remains to check the case where one exponent is positive, the 
other negative. Without loss of generality, say —m and n are positive. 

Suppose first that 0 < m+n. Since —m is positive, the preceding 


argument shows 


zc" = glmtn)+(—m) ne aL, LD 


Multiplying both sides by x” gives 71" = - x”, as claimed. 


If instead m+n < 0, then 0 < —(m+n), and 


rearranging establishes the asserted claim. 


(Proof of (iii)). For m and n non-negative, this follows by induction 
on the statement 


Fig) ee” =(2")™ for allm in N. 
To establish the inductive step, note that 


x 


n(m+1) _ gn = 72 7? = (am) = Ger 
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by (ii) and the definition of exponentiation. As a fringe benefit, we find 
that 


Ge) Sie ge =e) Morales Urall mand an IN 


—n 


If m <0 orn <0, replace x by x7! and use (x7!)" = 2 


The “limiting behavior” of 2” as n grows without bound plays a 
central role in analysis. 


Theorem 2.26. Let u>0 be a real number. We have 
l+nu<(1+u)” for alln>0. 


Proof. Let P(n) denote the inequality in the theorem. The base case 
P(0) asserts that 1 < 1, which is true. Assume inductively that P(k) is 
true for some k > 0. We have 


1+(k+lu<1+(k+ljutkw? 0< kw? 
= (1+ ku)(14+ u) Algebra 
<(1+u)*(1+4u) Inductive hypothesis 
=(1+u)*" Definition of exponentiation 


so that P(k) implies P(k + 1). 


Corollary 2.27. Let0<a<1. There exists a positive real number u 
such that x =1/(1+u), and 


0O<a"< 
1lt+nu 


for alln > 0. 


Proof. If 0 < x < 1, then 1 < 1/x by Theorem 2.18 (v), so we may 
write 1/2 = 1+ u for some positive real number u. By Theorem 2.26, 
we have 0 < 1+nu < (1/x)” = 1/(a") for all n > 0. Taking reciprocals 
again establishes the corollary. 


Factorials 


Definition 2.28. Let n > 0 be an integer. We define the factorial of n 
recursively by 


Qh as (n+1)!=(n4+1)-n! forn>0. 
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Example 2.29. Expanding the definition for n = 5, we have 
5S! = 5-41 = 5-4-3! =5-4-3-2! =5-4-3-2-1! =5-4-3-2-1-0! = 120. 


Generally, ifn > 0, then n! is the product of the positive integers from 
1 up to n, inclusive. The first ten positive factorials, whose values are 
worth knowing, are 1! = 1, 2! = 2, 3! =6, 4! = 24, 5! = 120, 6! = 720, 


7! = 5040, 8! = 40320, 9! = 362880, 10! = 3628800. 


Lemma 2.30. /fn, m > 0 are integers, then (n +m)! > (n+1)™nl. 
The inequality is strict ifm > 1. 


Proof. Fix n > 0, and argue inductively on m. When m = 0 or 1, the 
inequality is an equality. Inductively, if (n + k)! > (n+ 1)'n! for some 
k > 1, then 

(nt+k+1)!=(n+k+4+1)-(n+k)! 
(n+1)-(n+k)! 
nt+1)-(n+1)'n! = (n+ 1)*tnl, 


so strict inequality holds for m = k +1. 


Example 2.31. If n > 0, then (compare the case m = 2 in the lemma) 


(2n)! 1 1 


Qn+2)! (Qn+2)(Qn+1) ~ Ont? 


2.5 The Triangle Inequalities 


Definition 2.32. Let x be areal number. The absolute value of x is 


we Are 
|z| = 
—x ifx<0. 


Remark 2.33. For all real x, |—x| = |x|. That is, signs may be factored 
from an absolute value without changing the expression. 


Lemma 2.34. If x is real, then —|xz| <x < |a]. 


Proof. If x > 0, then |z| = x and —|zx| = —x < 0. Combining these 
inequalities, —|xz| <0 < a < |z|, as claimed. 
If instead x < 0, then |z| = —x and 0 < —ax = |x|. Consequently, 


—|t|)<a2<0< |]. 
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Proposition 2.35. Let x and b denote real numbers. 
(i) |x| < 6 if and only if —b<a<b. 
(ii) If |x| < b for allb > 0, then x =0. 


Proof. (i) By definition, 0 < |z] for all real x. If |x| < 6, then The- 
orem 2.18 (iii) gives —b < —|z| < 0 < |z| < 6. Combining with 
Lemma 2.34, we have —b < —|z| < x < |a2| < b. 

Conversely, suppose —b < x < b. If 0 < a, then x = |z|, and we 
immediately deduce |x| < b. If x < 0, then x = —|z], and by hypothesis 
we have —b < x = —|z|. Multiplying by —1 gives |z| < 6 in this case 
as well. 

(ii) The hypothesis involves infinitely many statements, one for each 
positive real number b, and no finite number of these hypotheses implies 
the conclusion. It is therefore more natural to consider the contrapos- 
itive, which turns out to be nearly obvious. If « 4 0, then 0 < |z|. 
Setting b = |z|/2, we have 0 < b < |z|. 


We now establish two of the most ubiquitous inequalities in analysis, 
the triangle inequality and reverse triangle inequality. 


Theorem 2.36. [fx and y are real numbers, then 
(i) jz t+y| < |z| + [yl 
(ii) |x —y| = |lx| —|yl]- 


Remark 2.37. In fact, | + y| < |x| +|y| and |x + y| > ||x| — |y]| for all 
real x and y, since | — y| = |y|. 


Proof. (i) For arbitrary real x, we have —|x| < x < |a| by Lemma 2.34, 
and similarly —|y| < y < |y|. Adding these inequalities and using (iii), 


—(\z|+|y|) <2t+y< |x| +|yI, 


which is equivalent to |x + y| < |x| + |y| by Proposition 2.35. 
(ii) Apply (i) to the identity y = x + (y — x), obtaining 


| Se ae ye. OE lg = |e) a, 


Reversing the roles of x and y shows |z| — |y| < |x — y|, and therefore 
ly| — |z| 2 —|z — y| = —ly — 2|. Combining, 


=a <4 — (2 < p= 2, 


By Proposition 2.35, ||y| — |z|| < ly — al. 
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Definition 2.38. Let x and y be real numbers. The distance between 
x and y is 


ly— a) =|e-—yl = 
x—-y ify<«@. 


Corollary 2.39. If x, y and z are real numbers, then 
(i) je -2| <|e@—y|+|z—y]. 
(iii) je — 2] > |e - yl — |e -l. 


Remark 2.40. These claims follow immediately by applying the corre- 
sponding part of Theorem 2.36 to the identity 


(x —z) = (a@—y)—(2—y). 


We may view real numbers z, y, and z as vertices of a (degenerate) 
triangle on the number line. Part (i) of the corollary says the length of 
a side of a triangle does not exceed the sum of the lengths of the other 
two sides. Part (ii) says the length of a side of a triangle is no shorter 
than the difference of the lengths of the other two sides. 


Min and Max 


Definition 2.41. Let a and b be real numbers. We define their mazi- 
mum and minimum by 


Bo ae <b; 
Ge IER, 


a ifa<ob, 


max(a, b) = 
b ifb<a. 


min(a, b) = 


Proposition 2.42. [fa and b are real numbers, then 
a+b+|a—D)| a+b-—|a—)| 
2 ; 2 


Proof. Adding and subtracting the formulas for max(a, b) and min(a, b) 
in Definition 2.41 gives 


max(a, b) = min(a,b) = 


max(a,b) + min(a,b) =a+b 
— ifa<b 
fathers oo, 
a—b ifb<a. 


The proposition follows by adding and subtracting these and dividing 
by 2, compare Exercise 2.4. 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


2.6. REAL ARITHMETIC ae 


Proposition 2.43. If A = {a1,a2,...,d,} is a finite set of real num- 
bers, there exist unique elements max A and min A in A such that 


minA<ax2<maxA forallaz in A. 


Remark 2.44. We call max A = max(aj, @2,...,@,) the largest element 
of A and min A = min(aj, d2,...,@,) the smallest element of A. 


Proof. (Existence). If A = {a,b} is a set of one or two elements, Defi- 
nition 2.41 defines min A and max A. Inductively, define 


max(@1, @2,..-,4n) = max(max(a1, (igs <t2G eyed) Gi) 
and check that « < max A for all x in A. The smallest element is 


defined similarly. 


(Uniqueness). If @ and a’ are elements of A satisfying x < a and 
x <a’ for all x in A, then a < a’ (since a € A) and a’ < a (since 
a’ € A), soa =a’. Uniqueness of min A is proven similarly. 


2.6 Real Arithmetic 


The real number line and base-10 notation for real numbers are prob- 
ably so familiar that it is difficult even to consider analyzing them 
closely. This brief, relatively intuitive section makes contact between 
the familiar number line and decimal notation of school mathematics 
on one hand, and our axioms for the real number system on the other. 


The Number Line 


Thanks to the order axioms, real numbers may be viewed as points 
on a line; x < y if and only if the point «x lies to the left of y. The 
real numbers 0 and 1 determine an origin and length scale. Two real 
numbers x and «+1 are separated by “unit distance”. In particular, the 
set of integers is situated along the number line with adjacent integers 
separated by unit distance. 

It will follow from the “Archimedean property” (Theorem 3.56) that 
every real number x can be written uniquely as an integer |x| plus a 
non-negative real number x — |x| < 1. If 0 < a, these are called, 
respectively, the integer part and fractional part of x. 
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Rational Numbers 


Let p and q be integers, g 4 0. The “rational number” p/q is the real 
number r = pq ', the product of p and the multiplicative inverse of q. 
Procedurally, 1/q represents a quantity, qg portions of which make 1, 
and p/q represents p units of size 1/q. The number p is the numera- 
tor; it specifies how many portions r comprises. The number q is the 
denominator; it specifies the size of each portion comprising r. 


——_§_—_+—_}_+—__+_}_+__ +—_}_ +_ + +++} 
S35) 2 Sd Oe yd 
2 2 2 2 


Nie + 
bo 
Nout 
w 
NIN + 
ow 
No 
ix 


Figure 2.1: Rational numbers on the number line. 


Remark 2.45. Three portions of size 1/3 make 1, as do 42 portions 
of size 1/42. Making q > 0 larger increases the number of portions 
required to make 1, so 1/q decreases in size when q > 0 increases. 

This is an example of Theorem 2.18 (v). It is also the basis of Yogi 
Berra’s quip: Asked by a waiter, “Do you want your pizza cut into six 
or eight pieces?”, Berra responded, “Better make it six; I could never 
eat eight pieces of pizza.” 


To add two rational numbers, we agglomerate amounts, first ex- 
pressing each summand as a fraction with a common denominator, 
then adding the numerators. To multiply rational numbers r and s, we 
regard s as a unit, of which a portion r is to be taken. 


Example 2.46. If r = 1/2 and s = 2/3, each summand can be repre- 
sented as a whole number of portions of size 1/6, so 


Te ig eT 


To multiply, we have 


since 2 portions of size 1/3 make 2/3. 


Proposition 2.47. If r = p,;/q, and s = p2/q2 are rational numbers 
and k #0 is an integer, then 


(i) r = (kpi)/(kq). 
_ Pid + qip2 
q192 


(ii) r+s 
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Proof. (i) Freely using the associative and commutative axioms for mul- 
tiplication, 


(kpi)/(kq1) = kpi(k*)(q¢") = k(K pi (ap) = pray!) = pi/a- 
(ii) Using (i), we have 


Pi, P2_ Pig2 | HP2 _ Pide + Mp2 


71 g2 q1492 q1q2 qq2 


1 


(iii) Since (qig2)~* = (a7 ')(@"), we have 


Pt PE = (pi) ar')(P2)(") = (Pipa) (quae)! = BE, 
ey 192 


Remark 2.48. These identities hold (with identical proofs) if the num- 
bers pi, @ #0, ..., are arbitrary real numbers, not merely integers. 


Corollary 2.49. The set Q of rational numbers is closed under addi- 
tion and under multiplication. If r € Q, then —r € Q. If in addition 
rZ#0, thenrt=1/reQ. 


Irrational Numbers 


Proposition 2.50. [fr is rational and x is trrational, then r+ x is 
irrational. Ifr £0, then rx is irrational. 


Proof. Contrapositively, if r+-x = s were rational, then x = s—r would 
be rational as well. If r 4 0 but t = rx were rational, then similarly, 
x =t/r would be rational. 


Remark 2.51. A sum or a product of irrational numbers can be either 
rational or irrational. Granting that every positive integer has a real 
square root, and that the square root of an integer is irrational unless 
the integer is a perfect square, V2 + (—V2) = 0 is rational, while 
V2+V/2 = 2/2 = VB is irrational. Similarly, (/2)(/2) = 2 is rational, 
but (/2)(V3) = V6 is irrational. 
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Decimal Representation 


Electronic computers perform exact integer arithmetic: If the operands 
and result do not overflow the machine’s native “word size” (at this 
writing, usually 2° — 1 = 18446744073709551615), then arithmetic is 
not subject to round-off error, and the associative, commutative, and 
distributive laws hold. A computer can be programmed to perform ex- 
act rational arithmetic, since a rational number is effectively an ordered 
pair of integers. 

However, most numerical work in a computer uses “floating point” 
arithmetic, which is not exact, i.e., does not obey the associative, com- 
mutative, or distributive laws. Thanks to the ubiquity of electronic 
calculators in the schools, you are probably much more familiar with 
floating point arithmetic and the associated “decimal notation” than 
with exact rational arithmetic. 

A finite decimal expression such as 3.14159 stands for a rational 


number: 
1 4 1 5 9 _ 314, 159 


10° 100, 000° 

The denominator of such an expression may be taken to be a power 
of ten. A rational number whose denominator does not evenly divide 
some power of ten can only be represented as an infinite decimal, albeit 
a decimal that eventually repeats after finitely many terms: 


+ =03 * = 018 T _ 0593 
aa ns Ec ee 
(A bar over a group of digits denotes an infinitely repeating pattern.) 
A careful proof that a non-terminating rational decimal p/q eventually 
repeats is slightly involved, but the idea is not difficult. We may write 
p = mq+r uniquely with m and r integers and 1 <r < q. (lf 
r = 0, then p/q = m is an integer.) Use the long division algorithm 
to divide r by gq. The remainder at each step can only be an integer 
between 1 and q—1. (If the remainder were 0, the decimal would 
terminate after finitely many places.) Since zeros are brought down 
at each step, only finitely many trial divisions arise. As soon as some 
remainder is seen a second time, the subsequent remainders repeat 
cyclically ad infinitum. 

Conversely, a repeating decimal expression always represents a ra- 
tional number. Again, a general proof is a bit involved notationally, 
but the idea is quite simple, and well-illustrated by an example: If 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


2.6. EXERCISES 31 


x = 3.14159, then we have 


100000z = 314159.159, 

100x = 314.159, 
313845 20923 
99900 6660” 


99900x = 313845, or x= 


Why Real Numbers? 


Exact rational arithmetic is simple and explicit, any two rational num- 
bers can be compared, and there exist arbitrarily small rational num- 
bers, such as 0.1, 0.01, 0.001, etc. Why not use rational numbers as 
the basis of analysis? 

In hindsight, the rational numbers have a serious defect. Intuitively, 
there exist quantities that we’d like to regard as “numbers” (because 
they can be approximated as closely as we like by fractions), but the 
quantities themselves are not rational numbers. 

The classic example is V2, the hypotenuse of a right isosceles tri- 
angle with unit legs. There is no rational number xz = p/q satisfying 
x? = 2. Nonetheless, 2 “exists” as a geometric length, and we can 
construct a sequence of rational numbers whose squares get “closer and 
closer” to 2; intuitively, we can approximate 2 as closely as we like 
by rational numbers. 


Exercises 


Exercise 2.1. Without using a calculator, express each of the fractions 
, 3 :, 2, and y as repeating decimals. 
Suggestion: You’ll need to do long division at least once, but can reduce 


the amount of computation by exploiting patterns. 


Exercise 2.2. Express 1.12, 0.249, and 0.0416 as reduced fractions. 


Exercise 2.3. Let x and y be real. Prove that ry = $((v+y)?—x?—y’). 
(In words, multiplication is uniquely determined by squaring.) 


Exercise 2.4. Let x, y, u, and v be real. Prove that 2u = x + y and 
2v =x —y if and only ifr=u+v and y=u-v. 


Exercise 2.5. Let x and y be real. Prove that x? = y? if and only 
if x = y or x = —y. (You may use the axioms and results from the 
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text. Do not use properties of square roots, which have not yet been 
established. ) 


Exercise 2.6. Alice and Bob have two sandwiches. Because Alice isn’t 
very hungry, they will split one sandwich evenly, and Bob will eat the 
other. 


(a) In order to distribute the food most nearly equally, should they 
split the smaller or the larger sandwich? 


(b) Formulate a precise mathematical model for the sandwiches, and 
use your model to give a proof of your assertion in part (a). 


Exercise 2.7. Let a, b, and c be real numbers, and assume a > 0. By 
completing the square, show that ax? + br +c > (4ac — b?)/(4a) for all 
real x, with equality if and only if « = —b/(2a). 


Exercise 2.8. Let n > 0 be an odd integer. Prove that if x < y are 
real numbers, then 2” < y”. 


Exercise 2.9. Give a formal proof by mathematical induction that if 
1, £2, ..., Ly are real numbers, then 


Jay to t--++ 4p] < ]ai| + |ae| +--+ + [xn]. 
Exercise 2.10. Let u > 0 be real. Use induction to prove that 


—1 
l+nu- mn Jw (14uy for all n > 0. 


Exercise 2.11. Let x and y be real numbers, and assume x < y. 


(a) Prove that x < $(a@+y)<yand x < $(2e+y) < $(x+2y) <y. 


(b) More generally, show that if 0 <t< 1, then # < (l—t)x+ty < y. 
(The expression (1 — t)x + ty is called a convex linear combination 
of x and y.) 


(c) If s<¢t are real, then (1—s)z+ sy < (1—t)x+ty. 


Exercise 2.12. Let x) and r > 0 be real numbers. Prove that if x is 
real, then 


(a) |x —29| <r if and only ifrp -—-r<xu<ag+r. 


(b) 0 < |x —20| <r if and only ifap —-r< a4 <2) 0ray <4 <a4ot+r. 
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Chapter 3 


Sets of Real Numbers 


3.1 Intervals 
Definition 3.1. Let a and b be real numbers with a < b. The sets 


(@,0):=49 in Rta < eb} 
[a,b] ={zin R:a<a <b} 


are called, respectively, the open interval and the closed interval with 
endpoints a and 0. 


Remark 3.2. There are also half-open intervals 
ia, ={e nm Rea a <b}, (a,0)= {2 in Ra <a bb 


though these play a relatively minor role in elementary analysis. 


Remark 3.3. For any of these intervals, the midpoint x9 = $(b +a) is 
called the center, r = |b — al is the radius, and |b—a| = 2r the length. 


r 
aD 


a=Xy—T XO b=a+r 


The formulas for min(a, b) and max(a, b) given by Proposition 2.42 
have geometric interpretations. These numbers are the left- and right- 
hand endpoints of the closed interval |a, b], and are reached by starting 
at the midpoint 29 and traveling a distance r to the left or right. 


33 
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Definition 3.4. Let x29 be a real number, and r a positive real number. 
When we wish to emphasize the center and radius of an interval, we 
use the notation 

B,(t0) = (%0 — 7, Xo +1), 
and call this set the (open) ball of radius r about xo. 


Proposition 3.5. Let a and b be real numbers such that a < b, and set 
ry = 5(b+a) andr =3|b—a|. Then 


(a,b) = {xz in R: |x — xo| < r}, [a,b] = {x in R: |x — zo| <r}. 


Proof. We have a = x —r and b=29 +r. If x is real, then x € (a,b) 
if and only ifa <a < bie, rm —-r< x4 < a+r. Subtracting x 
from each term gives —r < x — % < r, and by Proposition 2.35 this 
is equivalent to |x — xo| < r. Replacing the “<”s with “<” proves the 
assertion about the closed interval. 


Remark 3.6. Open balls are nested by transitivity of inequality: If 
r’ <r, then B,(xo) C B,(ao). This observation is of fundamental 
importance in analysis. 

Remark 3.7. As we have seen in Chapter 2, two distinct real numbers 
are not “neighbors”; if a < b, there is a “gulf” (a,b) separating a and b. 
In order to bridge this gulf, we must consider “neighbors” of x9 not as 
individual numbers, but as open intervals. 

Definition 3.8. Let a be a real number. We define unbounded open 
and closed intervals by 


(—co,a) = {xin R:2 <a} (aco) = {2 it Ra Sa}, 
(—co,a] = {xin R: 2 <a} [a,co) = {rin R:a< zh. 
Remark 3.9. The symbols —oo and oo do not denote real numbers, but 

are merely place-holders for an omitted inequality. 


Example 3.10. If a < b, then (a,b) = (—o0,b) N (a, ov), etc. 


Arithmetic of Intervals 


Analysis in one real variable deals not merely with individual numbers, 
but with intervals of numbers. We introduce special notation that 
facilitates calculations with intervals. 


Definition 3.11. Let xo be real, r > 0. We write x © xp + A(r), read 
“x is xo plus A of r”, to signify that |~ — xo| < r, namely that x is 
approximately equal to x9 up to an error of absolute value less than r. 
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Remark 3.12. In other words, x ¥ x + A(r) if and only if x € B,(2o), 
if and only if 7» —r < x < 2 +r. In this interpretation of an open 
ball, we call xp the value and r the error. 

Each of these three notations facilitates useful idioms, so it’s worth- 
while to become comfortable with each. 
Remark 3.13. We agree that x * x + A(0) means “x & x + A(r) for 
every r > 0”, namely that « = 2p in the usual sense. 
Remark 3.14. In the sciences, the “~” symbol is often used between 
two real expressions that are not exactly equal, but “are nearly enough 
equal for the sake of argument”, as in “sin@ = @ if 9 = 0”. Here we are 
giving the symbol precise meaning in a manner amenable to algebraic 
manipulation. 


Example 3.15. Experimental data and other empirical measurements 
always come with uncertainties. 

If the temperature J at noon at the airport was 74° F, to within 0.5°, 
we could write T = 74 + A(0.5). 

If a bacterial culture has density p of 1,000,000 per square millime- 
ter, give or take 100,000, we might write p ~ 10° + A(10°). 

If a baseball has a mass m of 143 grams with an uncertainty of 
0.05 grams, we could express this as m + 143 + A(0.05). 


Definition 3.16. Let M > 0. We write x + A(r) & A(M) to signify 
that if |z — x0| <r, then |z| < M. 


Example 3.17. Smaller errors correspond to “better” (more detailed) 
information. For example, 


V/2 = 1.4142136 + A(5 x 10-®) 
1.414 + A(0.0003) 
~ 1.4 +4 A(0.02). 


Theorem 3.18. Let xp and yo be real numbers, and let r and s be 
non-negative. Ifx % a +A(r) and y © yo + A(s), then 


(i) c+ty=aot+ytA(r+s). 
(ii) ey © xoyo + A(|2ols + rlyo| + rs). 


(iii) If in addition x + A(r) © A(M) and yo + A(s) & AUN) for some 
positive real numbers M and N, then 


ry & toyo + A(Ms + Nr). 
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Proof. Each is clear if r = 0 or s = 0. Assume r and s are positive. 
(i) By hypothesis, 79 —-r <4 <a4)+randy—s <y<yots. 
Adding these inequalities, 


(Zo + Yo) — (7 +8) <at+y< (o+yo)+(r +58). 
(ii) Writing x = x) + (a — xo) and y = yo + (y — yo), we have 
xy — XLoyo = (xo = x0) (yo oe ie yo)) — XoYo 
= x9(y — Yo) + (x — Xo) Yo + (x — Zo) (Y — Yo): 
The triangle inequality gives 
|zy — oyo| < [xo] ly — yol + |z — Lol [yo] + |e — Zo |y — yo! 

< |zols + rlyo| + 7s. 

(iii) If zp + A(r) & A(M) and yo + A(s) © ACN), then by (ii), 


zy — XoYo| < |zols + rlyo] + rs = (|2o| +r)st+rlyo| < Ms+ Nr. 


Example 3.19. If x © x + A(0.1), we have —3x ~ —3x9 + A(0.3), 
—32+5 % —3%79 +5+A(0.3), and 2? © x2 + A(0.2|xr9| + 0.01). 


Proposition 3.20. Let x) 4 0. Ifx ~ x0) +A(r) for some r < |xo|/2, 


then 
1 = 1 cA 2r . 
ZL Xo |x|? 


Proof. If x © a) + A(r) and r < |axo|/2, then |x — xo| < r < |xo|/2, 
or —|x — Xo| > —|x9|/2. Since x = xq — (Xp — 2), the reverse triangle 
inequality implies |x| > |xo| — |xo — x] > |zo|/2. 


0 |zo|/2 |zo| 3|Xo|/2 


That is, if ¢ + x +A(r) for some r < |xo|/2, then |x| > |xo|/2 > 0, 
so 1/|x| < 2/|xo|, and consequently 


1 1 


x XO 


_ | 209), 212 = wo 2 


[al {ol vol? [ao ? 
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3.2 Operations on Sets 


In Chapter 1, we encountered the complement of a set, the difference 
of two sets, and the union or intersection or an arbitrary family of sets. 
Starting from closed and open intervals, these operations can be used 
to construct interesting sets of real numbers, or to express interesting 
properties of the real number system. 


Example 3.21. Let x be a real number, and let r > 0. We define the 
deleted ball BX (xo) of radius r about 29 to be the set 


B,(xo) \ {to} = (@o — 7, Zo) U (20, Lo + 1) 
=F IR Oe = Ho) Ff. 


That is, B*(xo) is the ball B,(a9) from which the center zo has been 
removed. 


B,.(2o) 


=e CR oy ee) 


Example 3.22. For all real a, we have (—oo, a) = R \ [a, oo), etc. 


Example 3.23. Let a be a real number. The one-element set {a} is 
called a singleton. Every set can be written as the union of its singleton 


subsets: 
A= | J{a}. 


acA 


Definition 3.24. Assume A C R, and let c be a real number. The set 
c+A={ct+ta:ac A} 
is called the translation of A by c. The set 
cA={ca:ae€e A} 


is called the scaling of A by c. In particular, -A = {—a: a € A} is the 
reflection of A across the origin. 


Remark 3.25. If c = 0, then c+ A= A and cA = {0}. In practice, we 
almost always assume c ¥ 0. 
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Example 3.26. If A and B are non-empty sets of real numbers, we 
define their swm and product to be 


A+B={atb:a€Aandbe B}=|Ja+B, 
acA 


AB = {ab:a € Aandb € B} = |_JaB. 


acA 
Particularly, Z+ [0,1) =R, Z+Z=Z, andQ+Q=Q. 
Example 3.27. Let q > 1 be an integer. The set 
(2 = {p/q in R: p€ Z} 


consists of all rational numbers that can be represented as a (possi- 
bly improper and/or non-reduced) fraction whose denominator is pre- 
cisely q. 

The elements of iL are spaced regularly along the number line, with 
adjacent elements separated by a distance of 1/q, Figure 3.1. 

If q and q’ are positive, then (Z C oh if and only if q divides q’. 


-1 1 2 

e 0 ® o Z. 
e ‘© © * © e °5Z 
e oe 2 e- 2 oe 2 e- 2. +5Z 
e e © * © e * © © * e © °5Z 
e 2 2 2 ‘e- 2 ‘e- 2 ‘e- 2 2 2 2 ‘e- 2 oiZ 
e ° *° *° e e e e e od ad ° e e e e e ° °iZ 
¢- 40-0 $0 40 $ 004 __¢ _ to $0 4 0 4 004 _¢ too $0 $ 0 ¢ #0¢ 4 Q, 
eS Oe ee ih Sal ge eh a ae a a a i 9) 

6 3° 2.3 6 oe a eC am ce ae ae 


Figure 3.1: The sets GZ and Qy. 
Example 3.28. Let N > 1 be an integer. The set 
N 
av =U 
q=1 


consists of all rational numbers that can be represented as a (possibly 
improper and/or non-reduced) fraction whose denominator is no larger 
than N. 

The sets Qn are nested outward: Qn C Qnii = Qn U word. 
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Example 3.29. With the notation of Examples 3.27 and 3.28, the set 
of rational numbers can be expressed in two ways as an infinite union: 


Example 3.30 (The Cantor ternary set). Let [a,b] be an arbitrary 
closed interval. The weighted averages 


= 3(3a) < 3(2a+b) < $(a + 20) < §(3b) =b 


subdivide the interval into three pieces of equal length. The result of 
“removing the (open) middle third” of |a, b] is the set 


[a, 0] = [a, 6] \ ($(2a + b), $(a + 2b)) = [a, $(2a + 6) U [E(a + 28), B]. 


The closed intervals [a, $(2a + b)] and [4 (a+ 2b), 6] will be called the 
components of |a, b|” in this context. 

Recursively construct a family of sets as follows. Let Ko = [0,1] 
be the closed unit interval. Then let Ky be the result of removing the 
middle third of Ko, let Ky be the result of removing the middle third of 
each component of Ay, and generally, let K,,,1 be the result of removing 
the middle third of each component of Ky. 


Figure 3.2: Approximations to the Cantor ternary set. 


Mathematical induction shows the set K,, is a union of 2” compo- 
nents, each of length 3~-”. The sets K, are nested inward: Ky D Kn+4 
for each n > 0. 

The intersection 


K=()K. 


n=0 
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is called the Cantor ternary set, or simply “the Cantor set”. Each 
endpoint of K, is an element of Ky,+41;, and consequently “survives” 
in the intersection. The Cantor set therefore contains the union of the 
endpoints of the sets K,,. Since K,, has 2”*! endpoints, K has infinitely 
many elements. (A also contains “non-endpoint” elements. ) 

The Cantor set is self-similar. Precisely, K = 3K U 3(K + 2); 
the Cantor set is a union of two disjoint subsets, each a scaled copy 
one-third the size of the entire set. 


3.3. Upper and Lower Bounds 


Definition 3.31. Let A be a set of real numbers. A real number U is 
an upper bound of A if x < U for every x in A. If there exists an upper 
bound of A, we say A is bounded above (in R). 
A real number L is a lower bound of A if L < x for every x in A. If 
there exists a lower bound of A, we say A is bounded below (in R). 
The set A is bounded if A is bounded above and bounded below. 


Remark 3.32. If U is an upper bound of A and if U < U’, then U’ is 
an upper bound of A by transitivity of inequality. Similarly, if D is a 
lower bound of A and if L’ < L, then L’ is also a lower bound of A. 


Lower bounds L A Upper bounds U 
Oe Oo 
p L v U U' 


Example 3.33. Let a < b be real numbers. The interval [a,b] is 
bounded. The left-hand endpoint a is a lower bound, and the right- 
hand endpoint 6 is an upper bound. 

Every subset of a bounded set is obviously bounded. For example, 
the open interval (a,b) and the Cantor set kK C [0,1] are bounded. 


Remark 3.34. If A C R, then the following are equivalent: 
(i) L is a lower bound of A and U is an upper bound of A. 
(ii) AC [L,U]. 


Example 3.35. The set N of natural numbers is bounded below; 0 is 
a lower bound. As we will see presently (Theorem 3.56), N is not 
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bounded above in R. In other words, for every real number x, there 
exists a natural number n such that x < n. 

The set of integers is not bounded above or below, nor is any set 
that contains Z; thus Q and R are not bounded above or below. 


Proposition 3.36. A subset A of R is bounded if and only if there 
exists a positive real number M such that |x| <M for all x in A. 


Proof. If there exists an M > 0 such that |x| < M for all x in A, then 
—M <a<M for all x in A,ie., LD = —M and U = M are lower and 
upper bounds of A, respectively. 

Conversely, if L < a < U for all x in A, take M = 1+max(|L|,|U]). 
For all in A, we have —M < |L| << D<24<U<|U| <M. 


Remark 3.37. In practice, we often choose “symmetrical” upper and 
lower bounds for a bounded set. 


The Completeness Axiom 


Definition 3.38. Let A be a non-empty set of real numbers. A real 
number M in A is called the maximum of A or the largest element of A 
if ¢ < M for every x in A. 

A real number m in A is called the minimum of A or the smallest 
element of A ifm < x for every x in A. 


Remark 3.39. We often write M = max A and m = minA. If aset A 
has a largest element max A, then A is bounded above by max A. Con- 
trapositively, if A is not bounded above, then A has no largest element. 
Analogous remarks hold for lower bounds and smallest elements. 

Note carefully that a bounded, non-empty set A need not have a 
maximum element or minimum element, see Example 3.42. 


Example 3.40. A finite set of real numbers A = {aj,a2,...,@,} has 
a maximum and a minimum, see Proposition 2.43. 


Example 3.41. A closed interval [a,b] has a smallest element a and a 
largest element b. 


Example 3.42. Let a < b be real numbers. The open interval (a, b) is 
bounded below by a and bounded above by b, but contains no smallest 
or largest element: If x € (a,b), ie., ifa < x < b, then by Exercise 2.11, 


a<$f(at+z)<a< (a+b) <b. 
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In words, $(a+2) in (a, }) is smaller than x (so x is not the minimum), 
and 3(z + 6) in (a,) is larger. 


Definition 3.43. Let A be a set of real numbers that is bounded above. 
A real number {3 is called a least upper bound or supremum of A if 


(i) « < @ for all x in A, ie., 6 is an upper bound of A. 
(ii) For every upper bound U of A, we have 6 < U. 
Lemma 3.44. If ACR, and 8 and £' are suprema of A, then 6 = ['. 


Proof. By hypothesis, 6’ is an upper bound of A, so 6 < (’ by condi- 
tion (ii). Reversing roles, 3’ < £. 


Remark 3.45. We are therefore justified in writing sup A to denote the 
least upper bound of A; the symbol sup A may signify no number at 
all, but it never signifies more than one. 

The completeness axiom says that if A is a non-empty set of real 
numbers that is bounded above, then sup A € R. 

If A has a largest element, then sup A = max A. Otherwise, sup A is 
the leftmost number lying to the right of every element of A. 


Lower bounds L A Upper bounds U 
ee 
o—__e—__———__“# 
infA 2« sup A 


Proposition 3.46. Let A be a set of real numbers having a least upper 
bound 8. Then 6 is the unique number satisfying the conditions 


(i) Ifa eA, thenz < B. 
(ii)’ For every e« > 0, there exists an x in A such that B-—€ <a. 


Proof. Conceptually, the conditions (ii) and (ii)’ are contrapositives. 

In other words, ( is the least upper bound of A if and only if every 
upper bound U of A satisfies 6 < U. The contrapositive says that for 
every U < £6, U fails to be an upper bound of A. That is, for every 
€ > 0, there exists an x in A such that U = G-—e< uz. 


Everything said above for upper bounds has a corresponding con- 
cept or statement for lower bounds. 


Definition 3.47. A number a is called a greatest lower bound or infi- 
mum of A if (i) a is a lower bound of A, and (ii) If L is a lower bound 
of A, then L <a. 
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Remark 3.48. Geometrically, an infimum of A lies to the left of A, but 
is the rightmost such point. Infima are unique (if they exist), so we 
are justified in writing inf A. For practice, write out an alternative 
characterization of infima corresponding to Proposition 3.46. 


Proposition 3.49. Let A be a bounded set of real numbers, and let 
k; be a real number. 


(i) sup(k + A) =k+supA. 
(ii) [fk > 0, then sup(kKA) = ksup A. 
(iii) [fk > 0, then sup(—kA) = —kinf A. 


Example 3.50. If A = |a, }] is an interval, then k + A = [k +a,k +0]. 
If k > 0, then kA = [ka, kb] and —kA = [—kb,—ka]. In each case, 
the suprema can be read off by inspection. This is a useful way of 
remembering the conclusion of Proposition 3.49. 


Proof. The strategy in each part is to show that the right-hand side 
satisfies the two conditions for a supremum in Definition 3.43. 

(i) Since k+ A = {2 in R: 2c! = k +2 for some z in A}, a real 
number U is an upper bound of A if and only if « < U for all x in A, 


if and only if 2’ =k+a<k+U for allz’ ink+ A, 
if and only if k + U is an upper bound of k + A. 


But sup A is an upper bound of A, so k + sup A is an upper bound 
of k+ A. By Definition 3.43 (ii), sup(k + A) < k+ sup A. 

Conversely, sup(k+ A) is an upper bound of k+ A, so sup(k+A)—k 
is an upper bound of A. By Definition 3.43 (ii), sup A < sup(k+A)—k, 
or k +sup A < sup(k+ A). 

(ii) If & = 0, then KA = {0} and the claim is obvious. Assume, 
therefore, that 0 < k. The proof in this case is nothing but a mechan- 
ical modification of the preceding argument. The main idea is that 
multiplication or division by k preserves the sense of an inequality since 
0 < k, so areal number U is an upper bound of A if and only if kU is 
an upper bound of kA. Just as in the preceding argument, k sup A is an 
upper bound of kA, so sup(kA) < ksup A, and sup(kA)/k is an upper 
bound of A, so ksup A < sup(KA). 

(iii) Since —k < 0, multiplication or division by —k reverses inequal- 
ities. That is, L is a lower bound of A if and only if U’ = —kL is an 
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upper bound of —kA. Particularly, —k inf A is an upper bound of —kA, 
so sup(—kA) < —kinf A, and sup(—kA)/(—k) is a lower bound of A, 
so sup(—kA)/(—k) < inf A, or —kinf A < sup(—kA). 


The Extended Real Numbers 


Definition 3.51. Let +oo and —oo denote objects that are not real 
numbers, and extend the ordering on the real numbers by declaring that 
—oo < x < +00 for every real number x. The set R = RU {—oo, +00} 
is called the extended real number system. 


Remark 3.52. As yet we make no attempt to define addition or multi- 
plication involving +oo or —oo. 


Definition 3.53. If A C R is arbitrary, we write sup A = +00 if and 
only if A is not bounded above, and write inf A = —oo if and only if 
A is not bounded below. 


Remark 3.54. Every set A of real numbers has an infimum and a supre- 
mum in the extended real number system. 

If A = @, then sup A = —oo (because every extended real number 
is an upper bound) and inf A = +oo. The empty set is the only set 
whose supremum is smaller than its infimum. If a € A, then 


—oo <inf A <a<supA < +o. 


Proposition 3.55. Let A and B be non-empty sets of real numbers. If 
A CB, then inf B < inf A< supA < sup B. 


Proof. Every lower bound of B is a fortiori a lower bound of A. In 
particular, inf B < inf A. Similarly, sup A < sup B. 


The Archimedean Property 


Theorem 3.56 (The Archimedean property). For every number x, 
there exists a non-negative integer n such that x <n. 


Remark 3.57. In words, the set N of natural numbers is not bounded 


above in R. (Note that N is bounded above in R; +00 is an upper 
bound.) 
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Proof. Suppose to the contrary that there exists a real number x such 
that n < x for every natural number n. This means, by definition, that 
N is bounded above in R. By the completeness axiom, there exists a 
least upper bound w in R. 

By Proposition 3.46 with « = 1, the real number w — 1 < w is not 
an upper bound of N, so there exists a natural number no such that 
w—1< no. But we would then have w < n9 + 1, andnn +1EN 
by the definition of the natural numbers, contradicting the fact that 
w = supN. Contrapositively, if the axioms for the real numbers are 
logically consistent, then N is not bounded above in R. 


Corollary 3.58 (The generalized Archimedean Property). If M is an 
arbitrary real number and € > 0 is an arbitrary positive real number, 
there exists a positive integer n such that M < ne. 


Remark 3.59. Metaphorically, a journey of 1000 miles (MV) can be ac- 
complished one step (¢) at a time, no matter how small the steps are. 


Proof. Let « = M/e. By the Archimedean property, there exists a 
positive integer n such that M/e < n. Multiplying through by the 
positive number « gives M < ne. 


Corollary 3.60. If¢ is a real number and 0 < «, there exists a positive 
integer n such that 1/n < €. Contrapositively, if ¢ < 1/n for every 
positive integer n, then ée <0. 


Proof. Set x = 1/e, and note that 0 < x. By the Archimedean property, 
there exists an integer n such that 0 < x <n. Theorem 2.18 (v) implies 
that 1/n <. 


Remark 3.61. This corollary asserts, informally, that there are no in- 
finitesimal real numbers, i.e., no positive numbers that are smaller than 
every reciprocal of a positive integer. 


Example 3.62. The Archimedean property has noteworthy conse- 
quences for families of sets. For each positive integer n, define the 
open intervals A, = (0,n) and B, = (0,4). The Archimedean prop- 


erty implies 


C 8 


A,={cinR:c>0}, ()B,=2. 
T= 


ll 
mn 


n 


In particular, a union of bounded intervals may be unbounded, and an 
intersection of nested, non-empty sets may be empty. 
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3.4 Topology 


Definition 3.63. Suppose A C R, and let Ac = R\ A. For each x 
in R, exactly one of the following conditions holds: 


(i) There exists an ¢ > 0 such that B.(29) C A. In this case we say x 
is an interior point of A. 


(ii) There exists an ¢ > 0 such that B(x) C A®. In this case we 
say Xo is an exterior point of A. 


(iii) For every « > 0, the sets B.(ao) NM A and B-(a%9) M A® are both 
non-empty. In this case we say 2% is a boundary point of A. 


Remark 3.64. An interior point of A is obviously an element of A, since 
Xo € B.(x9) regardless of ¢. Similarly, an exterior point of A is never 
an element of A. However, a boundary point of A may lie in either A 
or its complement. 


Example 3.65. Let A = |[a,b) be a half-open interval. The interior 
points of A comprise the open interval (a,b). There are two boundary 
points, a and b, one of which is an element of A and the other not. 
Every other real number is an exterior point. 


Example 3.66. Every integer is a boundary point of Z, and every 
non-integer is an exterior point of Z. 

By Theorem 3.81 below, every real number is a boundary point 
of Q, the set of rational numbers. 

Every real number is an interior point of R. 


The next definition distinguishes two ways the punctured ball 
BX (ao) may be situated with respect to A. 


Definition 3.67. Let A be a non-empty set of real numbers. 

If x9 € A but there exists an ¢ > 0 such that BX(ao) NA = 2, then 
Xo is called an isolated point of A. 

If the set BX (xo) NA is non-empty for every ¢ > 0, then Zp is called 
a limit point of A (whether or not x9 € A). 


Proposition 3.68. Suppose ACR. If x9 is a boundary point of A, 
then x is either an isolated point of A or a limit point of A. 


Proof. By hypothesis, B-(zo) M A is non-empty for every « > 0. If 
Bx (ao) A is empty for some € > 0, then zp € A, so 2p is an isolated 
point of A. Otherwise xp is a limit point of A by definition. 
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Example 3.69. If A = [a, b) is a half-open interval, then every point of 
the closed interval [a, b] is a limit point of A, and there are no isolated 
points of A. The same conclusion holds for an open interval or a closed 
interval. 


Example 3.70. Every element of Z is an isolated point of Z. Similarly, 
if ¢ > O is an integer, then (2 consists entirely of isolated points. 


Definition 3.71. Let A be a set of real numbers. 
We say A is an open set if every element of A is an interior point 
of A, i.e., if A contains none of its boundary points (see Definition 3.63). 
We say A is a closed set if every limit point of A is an element of A, 
ie., if A contains all of its boundary points (see Theorem 3.73). 


Remark 3.72. Generally, a set contains some, but not all, of its bound- 
ary points, and is therefore neither open nor closed. 


Theorem 3.73. Jf A CR, the following are equivalent: 
(i) A is closed. 

(ii) A contains all of its boundary points. 

(iii) A° is open. 


Proof. If xo ¢ A, then xo is a boundary point of A if and only if for every 
e>0, AN B.(x0) 4 @, if and only if for every « > 0, AN BX(x0) £ @, 
if and only if zo is a limit point of A. 

By the preceding paragraph, A contains all its boundary points if 
and only if every point of A° is not a boundary point of A, if and only 
if every point of A‘ is not a limit point of A, if and only if A contains 
all its limit points, if and only if A is closed. 

Since the conditions in Definition 3.63 are mutually exclusive, A con- 
tains all of its boundary points if and only if every point of A° is an 
exterior point of A, a.k.a. an interior point of A‘, if and only if A®° is 
open. 


Proposition 3.74. An arbitrary open interval (a,b) is an open set. An 
arbitrary closed interval |a, b] is a closed set. 


Proof. Let a < 6 be real. 

If x € (a,b), ie, ifa <a <b, put e = min(x —a,b— Zz). Clearly 
e>Oanda<2-e<24<24+e< 6b, so B(x) C (a,b); that is, each 
element x is an interior point of (a,b). 
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To prove [a, }] is closed, it suffices by Theorem 3.73 to prove that 
R \ [a,b] = (—co, a) U (0, 00) is open. If x < a, sete =a—x >0 and 
note that B.(x) C (—co,a). Similarly, if b< x, takee =x—b>0. 


Definition 3.75. Let A be a set of real numbers. The set of interior 
points of A is called the interior of A. The set of interior and boundary 
points of A is called the closure of A. 


Proposition 3.76. A union of open sets is open, and a finite intersec- 
tion of open sets is open. Precisely: 


(i) If {O;}ier is an arbitrary family of open subsets of R, then U; O; 
1S Open. 


(ii) If {O;}*_, is a finite family of open subsets of R, then (),O; is 
open. 


Remark 3.77. By Theorem 3.73 and De Morgan’s laws for families of 
sets (see Exercise 1.11), an intersection of closed sets is closed, and a 
finite union of closed sets is closed. 


Proof. (i) Let {O;}ie7 be an arbitrary family of open sets, and let O de- 
note the union Lj,O;. If « € O, then x € O; for some i. Since O; is 
open, there exists an ¢ > 0 such that B(x) C O;. But O; C O, so x is 
an interior point of O; since x € O was arbitrary, the union O is open. 

(ii) Let {O;}%_, be a finite family of open subsets of R, and let 
O denote the intersection ();O;. If  € O, then x € O; for all 7, so 
there exist positive numbers ¢;, 1 < i < n, such that B.,(x) C Oj. 
The minimum, ¢ = min(€, €2,...,€n), is positive, and for all i we have 
B.(«) c Bz,(2) c O;, sO B(x) c O. 


Proposition 3.78. The Cantor set K is closed, contains no interval, 
and contains no isolated points. 


Proof. (K is closed). Each set kK, is a finite union of closed intervals, 
hence is closed. Thus K = (),, K,, is an intersection of closed sets, and 
hence is closed. 


( contains no interval). It suffices to prove K contains no open 
interval (a, 3), since every interval contains an open interval. The 
strategy formalizes Figure 3.2. Every open interval (a, 3) has positive 
length. However, each “approximating” set K, is a union of inter- 
vals of length 3~-”, and Corollary 2.27 guarantees 3°" < 1/(2n +4 1). 
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By the Archimedean property, no positive real number is smaller than 
1/(2n+1) for all n. That is, for every open interval (a, 3), there exists 
an n such that (a, 3) Z K,. This implies (a, 8) Z K. Since (a, 3) was 
arbitrary, K contains no interval. 


( contains no isolated points). In other words, every point of K is 
a limit point of K: If a € K, then every deleted ball BX (xo) contains 
a point of kK. The strategy is similar to the preceding paragraph. If 
€ > 0 is arbitrary, there exists an n such that 3°" < «. But 7) € K 
and K C Ky, i.e., Zp is an element of some component of K,,. Both 
endpoints of this component are closer than 3~” to Xo, and at least one 
endpoint, say x, differs from xp. This means that 7 € KM BX (xo). 


Density of the Rational Numbers 


Definition 3.79. A set A of real numbers is dense (in R) if every real 
number is a boundary point of A, i.e., if for every real number x and 
every € > 0, there exists a number 2 in A such that |x — xo| < €. 


Remark 3.80. If A is dense in R, then every real number can be ap- 
proximated arbitrarily closely by elements of A. 


Theorem 3.81. Let x < y be distinct real numbers. There exists a 
non-zero rational number r = m/n such thatx <r < y. 


Remark 3.82. In words, the set Q of rational numbers is dense in R: 
If x € Rand if e > 0, there exists a rational number r = p/q such that 
D<Kr<KyH=Ute. 


Proof. Assume first that 0 < 2 < y. The real number ¢ = y— 2x 
is positive because x < y. By Corollary 3.60, there exists a positive 
integer n such that 1/n < «. It suffices to prove that some integer 
multiple r = m/n lies between x and y. Geometrically this is plausible: 
By taking steps of size 1/n across the interval between x and y, we 
must step in the interior at least once. 

Formally, consider the set S = {p in Zt : y < p/n}. By the gen- 
eralized Archimedean property, there is a positive integer p such that 
y < p/n; that is, the set S is non-empty. Now, a non-empty set of 
positive integers has a smallest element, say m+ 1. By definition of 
the set S, we have m/n < y < (m+ 1)/n. To complete the proof, it 
suffices to prove x < m/n. But 

m J m+1 _m 


i 
y— S =—<y-w@. 
n n Wi sae 
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Rearranging the inequality gives x < m/n. We have proven that if 
0 <a < y, then there exists a non-zero rational number r = m/n such 
thats <7 < yy, 

If instead « < y < 0, then 0 < -—y < —a. By the preceding 
argument, there exists a rational number r 4 0 such that —y < r < —a, 
so the non-zero rational number —r satisfies x < —r < y. 

Finally, if neither alternative holds, then x < 0 < y, and by the first 
part of the proof there is a rational number x <0 <r < y. 


Remark 3.83. Theorem 3.81 says that between any two real numbers 
can be found a rational number. Moreover, between any two real num- 
bers can be found an irrational number. For example, if x < y, then 
by Theorem 3.81 there exists a non-zero rational number r such that 
r/V2<r <y/V2, ie., such that 2 < r/2 < y. But rvV2 is irrational 
by Proposition 2.50. 

It is tempting to conclude that rational and irrational numbers “al- 
ternate” along the number line, as if by painting rational numbers red 
and irrational numbers blue, the number line would consist of alternat- 
ing red and blue points. Unfortunately, this picture is utterly incorrect. 
Distinct real numbers are never adjacent to each other, but instead are 
endpoints of an interval containing infinitely many rational and irra- 
tional numbers. 


Exercises 


Exercise 3.1. Show that: 

(a) Ife = A(1), then 2? © A(|2|) and (1+ A(|a|))” © 1+ 3A((2). 
(b) If x A(0.75), then 0.25 <1+a< 1.75 and 1/(1 +2) © A(4). 
(c) If x = A(1), what can be said about 1/(1 + x)? 


Exercise 3.2. If x © 1.56+A(0.005) and y © 2.13+A(0.005), calculate 
x+y, and show that ry + 3.588 + A(0.02) % 3.6 + A(0.04). 


Exercise 3.3. In each part, let x and h be real numbers, h # 0. 


(a) Show (x + h)? — x? & 2rh + A(h?). 


(b) Show (x + h)? — x3 & 3x7h + (3]2| + |h|)A(h?). 


(c) Find an analogous formula for (x + h)* — 2+. 
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(d) Use part (a) to show 


(2 +h)? — x? 


i r 2x + A({Al). 


Find corresponding formulas using parts (b) and (c). 


Exercise 3.4. If r > 0 and 2p are real, let B,(a9) denote the deleted 
neighborhood of radius r about x9. Prove that 
(a) BY(0) = rBy (0). (b) Be (xo) = to + By (0). 


Exercise 3.5. Let a < b be real numbers. Find real numbers r > 0 
and 2X9 such that 
(a) [a,b] = x + r(0, 1]. (b) [a, 6] = zo + r[—1, 1]. 


Exercise 3.6. Let A = {4 : n € Zt}. Make a sketch of A, and 
determine which real numbers (if any) are interior points of A, exterior 
points of A, boundary points of A, isolated points of A, limit points 
of A. Is A closed? 


Exercise 3.7. For each positive real number 7, let O, = B*(0) be 
the deleted neighborhood of radius r about 0. Determine {),.O, with 
justification. 


Exercise 3.8. Let A be a bounded set of real numbers, and let k be 
a real number. Formulate and prove a version of Proposition 3.49 for 
infima. 


Exercise 3.9. Let x be a real number. Find an infinite family {O,,} 
of open sets whose intersection is {x}. (This shows that Proposi- 
tion 3.76 (ii) does not extend to arbitrary families of open sets.) 


Exercise 3.10. For n > 1, let A, = [4, 4]. Express the union U,, An 
as an interval, with proof. 


Exercise 3.11. For each positive integer n, let I, = [an, bn] be a closed, 
bounded interval of real numbers. Prove that if the intervals are nested 
inward, ie., if J,4; C J,, then the infinite intersection (),, J, is non- 
empty. (Compare Example 3.62, in which the sets B,, are not closed.) 
Hint: Consider the sets A = {a,} and B = {b,}. Show that A is 
bounded above, B is bounded below, and sup A < inf B; conclude that 
[sup A, inf B] is contained in (),, In. 
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Exercise 3.12. Let O be a non-empty open set of real numbers. This 
exercise outlines a proof that O is a union of open intervals. 


(a) Suppose x € O, and put 
de int {ts (ft) Gok b, = sup{t : (x,t) C O}. 
Prove that a, < x < by (note strict inequalities). 


(b) In the notation of part (a), prove that (a,,b,) GC O, and that no 
strictly large open interval is contained in O. (An interval of the 
form (dz, bx) is called a component of O.) 


(c) Prove that O is the union over x in O of the components (dz, b,). 


Exercise 3.13. Let O = {cin R: « #4 0,2 F £1/n for all n > 1}. 
Sketch the set O, show O is open, and find the components of O. 


Exercise 3.14. Let A,, Ao, A3,..., be non-empty sets of real numbers, 
each consisting entirely of isolated points. 


(a) Prove that A; U Ag consists entirely of isolated points. 
Hint: Suppose rp € A,;UAp. If BX (x) NA, = @ and BX(x)N Ag = 
@, let € = min(€\, €9). 


(b) Prove that A; U Ag U---U A), consists entirely of isolated points. 
In particular, Qj consists entirely of isolated points. 


(c) Show by example that the infinite union L),, An may consist entirely 
of isolated points, or may be dense in R. 
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Sequences 


Definition 4.1. Let ko be a non-negative integer. A real sequence is 
a collection of ordered pairs (k,a,) in which k > ko is an integer and 
ay is areal number. We call a, the kth term of the sequence. 


Remark 4.2. The “first coordinate” k imposes an ordering on the 
terms ax. A sequence is often denoted (a,)7°,,, or simply by (ax), in 
order to emphasize its interpretation as an infinite ordered list of real 
numbers. The ordering of the terms is crucial; a sequence must be 
carefully distinguished from its set of terms A= {a,:k > ko} CR. 
By convention, kg = 0 unless the contrary is explicitly stated. In 
this case, using the terminology of Chapter 5, a real sequence is a 
“mapping” a: N > R, and a, = a(k) is the “value” of a at k. 


Example 4.3. The formulas a, = 1/(k+1) and b, = (—1)* define real 
sequences. The respective sets of terms are A = {1,3,3,],...}, and 
the finite set B = {1, -1}. 


d 


Example 4.4. For each real number z, the formula a, = x* defines a 
real sequence. 


Example 4.5. The recursive specification 


1 2 
dg =2, Akt1 = 5 | ae + — 
2 Qk 


defines a real sequence. The next three terms are a = 3/2, a2 = 17/12, 
and a3 = 577/408. 


53 
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Example 4.6. The recursive rule a;41 = a,+ [1/(k+1)], with ap = 0, 
defines a sequence whose nth term (n > 1) may be written 


4.1 Convergence 


Definition 4.7. Let (a;,) be a real sequence, and let a, € R. We say 
(ay) converges to dx, and write (az) > do, if the following condition 
holds: 


For every ¢ > 0, there exists a natural number N such that 
if k > N, then |a, —a.| <e. 


Remark 4.8. The definition may alternatively be expressed: 


For every ¢ > 0, there exists an index N such that ifk > N, 
then ag © do + A(e). 


In words, the terms a, can be made “as close as we like” to ay (i.e., 

within an error of ¢ > 0, no matter how small ¢ is chosen) by “going 

sufficiently far out into the sequence” (i.e., considering only terms a, 

with k > N). Loosely, “the a; eventually get arbitrarily close to a”. 
A crucial aspect of the condition is that ¢ is chosen before N. 


Proposition 4.9. Jf (a,) is a real sequence that converges to ax. and 
10.4) REM Gigs = Og 


Proof. Let ¢ > 0 be arbitrary. Since (ax) + do, there exists an in- 
dex N, such that if k > Nj, then ja, — a.| < ¢/2. Similarly, since 
(a,) — al, there exists an index Nj such that if k > N{, then 
la, — a,,| < e/2. 

Let N = max(N,, Nj). Since N > N, and N > Ni, the triangle 
inequality implies 
|a55 = Aoo| = |(a5, — an) + (an — Go0)| 

< lai, — ay|+ lan — aq] < (€/2) + (€/2) =e. 


But ¢ > 0 was arbitrary, which means a), — ax = 0. 
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Remark 4.10. Proposition 4.9 says that a real sequence converges to at 
most one number. If (az) > do, we call ax the limit of (ax), and write 
Ao = jim Qh. 

00 


Remark 4.11. Informally, we say “az, approaches do as k + oo”. In- 
deed, the notation a, is meant to suggest “setting k = oo in the limit”. 
Logically, however, this is not what convergence means. The terms ax 
of a sequence (a,) are merely individual real numbers, which do not 
“approach” anything. It is the sequence (i.e., the ordered list of terms) 
that converges (or fails to converge) to a limit. 


The ¢«-N Game, and Examples 


Convergence of a sequence may be understood as an adversarial game. 
A sequence (a;) and a putative limit a, are specified in advance. The 
first player chooses a positive “tolerance” ¢, which defines a target, the 
interval Bz(doo) = (doo — €, doo + €). 

The second player now tries to “hit the target”, i.e., to ensure that 
|az — Ao.| < €, solely by taking k to be sufficiently large. A “successful 
response” to the first player’s “challenge” is a positive integer N such 
that if k > N, then |a, — aq| < e. 

If Player N is able to respond successfully to a particular ¢, they 
“win the round”. Otherwise Player ¢ wins the round. 

To say (ax) — Go means that Player N has a winning strategy 
against a perfect opponent: No matter how “skillful” Player ¢ is (i-e., 
no matter how small ¢ > 0 is chosen), Player N can always issue a 
successful response. 

Success in analysis is largely a matter of learning to play the e-N 
game and its variants (to be studied later). When you read proofs, you 
may notice that seemingly magical choices of N are made. To make 
these choices, the author imagined an arbitrary ¢ > 0 was given, and 
formulated a strategy for choosing a “winning” index N. The proof 
itself is merely a written demonstration that Player N wins. 


Remark 4.12. Yet another interpretation of convergence of a sequence 
has the procedural appeal of a solitaire game. Imagine an infinite deck 
of playing cards in which the kth card has the term a, of the sequence 
written on its face. The cards are placed in a row in order, face up. 
Now an € > 0 is specified, and for each k, if ja, —ax| > ¢, the kth card 
is turned face down. At issue is whether all the cards past some point 
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remain face up, i.e., whether only finitely many cards must be turned. 
If this is the case no matter how € > 0 is specified, we say (ag) + Aco. 


Example 4.13. Let c € R. The sequence a, = c is called a constant 
sequence. A constant sequence obviously converges to a, = c: For 
every € > 0 and for every k, we have |a, —a.| = |c—c| =0 < e. That 
is, Player N cannot lose against a perfect opponent when playing with 
a constant sequence! 


Example 4.14. The sequence a, = 1/(k + 1) converges to 0. Before 
giving a proof, we'll play a few rounds of the e-N game. 

If ¢ = 100, Player N cannot lose, and in particular may take N = 0: 
Indeed, |a, — 0| = 1/(k +1) < 1 < «€ regardless of k. Note carefully 
that this fact by itself does not prove (a;,) — 0; Player N must be able 
to win against an arbitrary ¢ > 0. 

If ¢ = 0.01 = 1/100, player N may take N = 100: If k > 100, then 
ja, —0| =1/(k +1) < 1/101 < 1/100 =<. 

If ¢ = 1/./200 (assuming such a real number exists), Player N’s goal 
is to find an N such that 1/(N+1) < e = 1/200, or after rearranging, 
200 < (N+1)?. The “best” (i-e., smallest) choice, N = 14, is easy 
to find in this example, but there is no harm in taking, for example, 
N = 200, which is surely sufficient. 

To show (a;,) — 0, it suffices to construct a winning strategy for 
Player N. Let ¢ > 0 be arbitrary. By Corollary 3.60 of the Archimedean 
property, there exists a positive integer N such that 1/N < «. This N 
is our response. If k > N, then |a, —0| =1/(k +1) < 1/N <e. 


Remark 4.15. If an index N “wins” against some challenge ¢ > 0, then 
every larger integer N' > N also wins, because k > N’ implies k > N. 
It is not necessary (or desirable) to pick the smallest winning N. 

Correspondingly, making ¢ smaller makes the target smaller, which 
makes the condition a, © a, + A(é) is “harder to meet”, and generally 
forces N to be larger. 


Remark 4.16. The standard idiom for picking a single N satisfying 
finitely many conditions is to pick multiple Ns, each satisfying one 
condition, then let our response be the largest of our choices. This was 
done already in the proof of Proposition 4.9. 


Example 4.17. The sequence a, = (—1)* has terms that are alter- 
nately 1 and —1; precisely, the “even” terms agg are all 1 and the 
“odd” terms age4; are all —1. We will show that (a;,) has no limit. 
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That is, for every real number ax, the statement “(a,) > a.” is false. 
To prove this, we fix a putative limit a. arbitrarily, then take the side 
of Player ¢ and look for a winning strategy: 


No matter what N is, k =2N > N iseven, andk =2N+1>N 
is odd. We are therefore assured that |a;,—a..| takes both values 
|1 — ag| and | — 1 — a] = |1 + aq| for some k > N. In order 
to win, Player N must make both of these quantities smaller 
than ¢. But in that event, the triangle inequality would imply 
2< |l-—ago|+|l+an| < e+e = 2. If this inequality is not 
satisfied, Player N loses. 


Having reasoned thusly, Player ¢ chooses any ¢ with 0 < ¢ < 1. For 
definiteness, take ¢ = 1. By the preceding reasoning, there does not 
exist a positive integer N such that if k > N, then jag, —ax| <¢=1; 
if such an N existed, we would have 


2< |l—a.|+|1+ aq] = |aen — dol + |aeny1 + do] < e+e =2, 


which is false. Since “(a,) + a.” is false for every real number aq, 


the sequence (a,) = ((—1)*) has no limit. 


Theorem 4.18. Let x be a real number satisfying -1 <a <1. The 


sequence a, = x* converges; the limit is 1 if x =1, and is 0 otherwise. 


Proof. If x = 1, the sequence (ax) is constant (since a, = 1* = 1 for 
all &), and therefore converges to 1 as noted above. Similarly, if x = 0, 
then a; = 0 for all k. 

For the remainder of the proof, assume 0 < |x| < 1, and set a, = 0. 
By Corollary 2.27, if we write |r| = 1/(1 + u), then |x*| < 1/(1 + ku) 
for all k > 0. 

Fix ¢ > 0 arbitrarily. By the generalized Archimedean property, 
there exists a natural number N such that 1/(Nu) < e. Ifk > N, then 
Blige : Ea be <e. 

~1+ku ku 7 Nu 
By definition, this means (x") > a. = 0. 


|a* — Ao| = |x 


Example 4.19. For x = 1/2 or x = —4/5, say, the conclusion of 
Theorem 4.18 is not intuitively surprising. However, for a number such 
as x = 0.99999999999999999999 = 1—10-?°, a “fairly large” exponent n 
may be needed to make the power x” “small”. 


Remark 4.20. The sequences in Examples 4.5 and 4.6 cannot be handled 
so naively from the definition. We turn next to theoretical criteria that 
help resolve these examples. 
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Boundedness 


Definition 4.21. A real sequence (a,) is bounded above if its set of 
terms is bounded above, i.e., if there exists a real number M such that 
ay < M for all k. Any particular M is called an upper bound for the 
sequence. 

Similarly, we say (az) is bounded below if there exists a real num- 
ber m such that m < a, for all k. 

We say the real sequence (a,) is bounded if (a,) is bounded above 
and bounded below, namely (Proposition 3.36), if there exists a positive 
real number M such that —M < ay < M, ie., |ax| <M, for all k. 


Remark 4.22. Geometrically, a sequence is bounded above if every term 
lies to the left of some fixed real number, and is bounded below if every 
term lies to the right of some (other) number. 


Proposition 4.23. [f(a;) is a convergent real sequence with limit aso, 
then 


(i) (az) is bounded. 
(ii) The sequence (|ax|) converges to |a.c). 


Proof. By hypothesis, for every ¢ > 0, there exists an N such that if 
k > N, then lax — aq] < €. 

(i) Taking « = 1, there exists an N such that ja, — a.| < 1 for 
k > N. Let M = max(|aol, |ai|,..-, |@n—il, |@o0.| + 1). It suffices to 
show |a;,| < / for all k. 

If0 <k < N, then |ax| < M by construction. If k > N, the triangle 
inequality implies 


Jax] < loo] + lak — Goo] < |@oo] +1 < M. 


In summary, |ax| < M for all k. 

(ii) Let ¢ > 0, and choose N such that if k > N, then |a;, —aq| < €. 
By the reverse triangle inequality, ||@%e| — [a0] | < lap—ay| <cifk > N. 
Since € > 0 was arbitrary, (|az|) 4 doo]. 


Monotone Sequences 


Definition 4.24. Let (a;) be a real sequence. 
If ay < apy, for all k, namely if a, < ay whenever k < k’, we say 
(ax) is non-decreasing. 
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If ap41 < ay for all k, namely if ay < ay whenever k < k’, we say 
(az) is non-increasing. 

A sequence that is either non-decreasing or non-increasing is said 
to be monotone. 


A slightly more general condition is useful in practice, and does not 
require much extra work to accommodate. 


Definition 4.25. A real sequence (a;,) is eventually non-decreasing if 
there exists an index Nop such that ay <a, whenever No < N <k. 


Example 4.26. The real sequence defined by ay = k?/(k? — 500) is 
eventually non-decreasing, since 


k? _ k= 500+500 500 
k2—500 k2?—500 | k? — 500’ 


and if k? > 500, ice., if k > 23 = No, the denominator increases with k. 


Example 4.27. The real sequences defined by a, = (—1)*k or by 
a, = (—1)*/k are not eventually non-decreasing. 


For practice, give definitions of eventually non-increasing and even- 
tually monotone real sequences, and modify of the statement and proof 
of Theorem 4.28 below to handle these types of sequence. 


Theorem 4.28. [f (a;,) is an eventually non-decreasing sequence, then 
(i) (ax) is bounded below. 
(ii) (ax) converges if and only if it is bounded above. 


Proof. By hypothesis, there exists an integer No such that ay < ay 
whenever No < N <k. Particularly, an, < ay if No < k. 

(i) The real number m = min(do,a1,...,@y,) is a lower bound 
for (ax): By construction, m < a, for 0 < k < No. On the other 
hand, if No < k, then m < ay, < ax as noted above. 

(ii) (Convergent implies bounded above). By Proposition 4.23, a 


convergent sequence is bounded, hence bounded above. 


(Bounded above implies convergent). Suppose there exists a real 
number M such that a, < M for all k. The set A = {ax : No < k} 
is non-empty and bounded above by M, so a~ = supA exists by the 
completeness axiom. It suffices to prove (az) > doo. 
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Let ¢ > 0 be arbitrary. The number ay — € < do is not an upper 
bound of A, so there exists an integer N > No such that ay — € < an. 
Ifk > N, then ay < ax, < sup A, so 


Ago —E< AN S Ap S Ay < Ag +E. 


That is, if k > N, then a, © ay + A(e). Since ¢ > 0 was arbitrary, we 
have shown (az) > doo. 


Example 4.29. The sequence a, = 1/(k +1) is non-increasing, and 
is bounded below since every term is positive. Consequently, (a,) con- 
verges to Gd. = inf{a,}. Of course, we have already seen that this 
sequence converges to 0; here we have deduced a less specific conclu- 
sion using a more general theorem. 


Example 4.30. Consider the sequence (a,) in Example 4.5. By mathe- 
matical induction, each term is positive and satisfies ag—2 > 0. Further, 
the sequence is non-increasing since 


1 29 1 2 aj-2 | 
ak — a = ak — Qk + = Aaky- — |] = . 
k k+1 k ~ 5 \ Oe a 5 \% x oa 


Consequently, lim a; exists. Note that we have shown that this sequence 
converges without explicitly exhibiting the limit. 


Algebraic Properties of Limits 


Theorem 4.31. Let (ax) and (by) be real sequences converging to dx 
and b,, respectively. 


(i) (ay + b,) converges to dg + doo. 
(ii) (azby) converges to Axoboo- 
(iii) Ifb, £0 for allk and if b,, #0, then (az/by) converges to Axo/Doo- 


Proof. (i) Let ¢ > 0 be arbitrary. By hypothesis, there exists an inte- 
ger N, such that if k > Ni, then ag, © aw + A(e/2). Similarly, there 
exists an integer Nz such that if k > No, then by © by + A(e/2). Let 
N = max(Nj, No). 

By Theorem 3.18, if k > N, then ag + by © doo + bo + Ale). Since 
€ > 0 was arbitrary, (ax + dp) 4 doo + Doo. 
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(ii) By Proposition 4.23, there exist positive real numbers L and M 
such that 1+ |a,| < 2 and 1+ |b;,| < M for all k. Let ¢ be an arbitrary 
real number with 0 < ¢ <1, and put r=¢/2M <eand s=6/2L. 

Since (az) — doo, there exists an integer N,; such that if k > M,, 
then ag © dx + A(r), and since (bg) + boo, there exists an integer N2 
such that if k > No, then by © by + A(s). 

Let N = max(Nj, No), and note that |a.| < jaw|te < L. Ifk > N, 
Theorem 3.18 (ii) implies 


Anbk Y Acodoo + A(|doo|s + Mr) 
RY Acoboo + A(L + ¢/2L + M-e/2M) 
FZ Acodoo + A(E). 


Since ¢ > 0 was arbitrarily small, (agbyp) 4 dooboo- 

(iii) We first prove that (1/b,) > 1/b.. Fix e > 0. With the goal 
of applying Proposition 3.20, put r = 5 min(|b.o|, €- |b.0|?). Note that 
r > 0 because |b,,| > 0, and 27/|b..|? < € by construction. 

Because (by) — boo, there exists an integer N such that if k > N, 
then by © by. + A(r). By Proposition 3.20 with x = by and 2 = by, 


1 1 2r 1 
~) L A ~) L A(e), 
bi; Dox ( |b 2) Boo 6) 


(iii) now follows immediately from (ii) by writing 7" = aks. 
k k 
Remark 4.32. The preceding proof uses our “computational” A nota- 
tion. To give the “standard” proofs, first translate ap © do + A(e/2) 
into |az — do| < €/2, etc., throughout. 
For (i), the translation is essentially complete. For (ii), choose pos- 
itive real numbers MW, L, and an integer N as above, then invoke alge- 
braic identities and the triangle inequality; if k > N, then 


lander = Ges Disa! = |andee = AoodK + AoodK = Gad0ss| 
Ss lade = Aoodx| + |dcobx, = diggD| 
= |Ap — Ago] [be] + |aoo| |be — Bool 


E E 
—-M+—.-L : 
* oi T oF <€ 


For (iii), pick r > 0 as above, and write 


ee [= Hs OP gs 
by Boo |bx.| [Boo | [Boo |? = 


Ei 
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In short, the “standard” proof focuses on the difference between a term 
of a sequence and the limit. The A notation proof writes the limit as 
the sum of a term and an error, and focuses on bounding the error. 


Example 4.33. Let m be a positive integer. The sequence (a,)?2, 
defined by a, = k~™ = 1/k™ converges to 0. When m = 1, this 
assertion is proven in Example 4.14. For larger m, Theorem 4.31 (ii) 
establishes the inductive step. 


Example 4.34. In practice, Theorem 4.31 is often invoked without 
formally defining a sequence. The theorem grants license to move a 
limit into or out of an arithmetic expression: 


fim BI tig P= /A) _ Lali (/e) _ 1 
ok (2k)/k2 lim, (1/k) 0 
ope Ieee) iim) a 


lim () = (im “-) aL) =: sete: 


k-oo 


In the third example, the integer exponent m > 0 is arbitrary, but 

“fixed” , i.e., independent of &. Bringing the limit inside the parentheses 

implicitly involves an inductive argument together with Theorem 4.31. 
Note carefully that Theorem 4.31 does not imply 


As we will see in Chapter 10, this limit is not 1, but e, an irrational 
number that pervades pure and applied mathematics. 


Limits and Inequalities 


Proposition 4.35. Let (a,x) and (by) be convergent real sequences, with 
respective limits ag and bo. 


(i) If0 < ay for all but finitely many k, then 0 < dg. 
(ii) If ax < by for all but finitely many k, then do < boo. 


(iii) [fc <a, <d for all but finitely many k, thence < ay <d. 
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Remark 4.36. In words, “non-strict inequality is preserved in the limit”. 
Note that strict inequality is not generally preserved in the limit: We 
have 1/k > 0 for all k > 1, but lim; 1/k = 0. 


Proof. (i) We prove the contrapositive: If a, < 0, then a, < 0 for 
infinitely many k. 

Put ¢ = —a./2, so € > 0 by hypothesis. Since (ax) 4 doo, there 
exists an N such that if k > N, then |jay—ax| <¢. But |a,—an| < cif 
and only if €../2 < ap—dc < —G/2, and this implies a, < ax/2 < 0. 
That is, if k > N, then a, < 0. 

(ii) Define cy, = by — ax. By hypothesis, 0 < c, for all but finitely 
many k. By Theorem 4.31, (cy) converges to by — doo. Part (i) implies 
0 < boo — Gao, L€., Boo < Doo. 

(iii) This follows immediately from (ii). 


Divergence to Infinity 


The definition of sequential convergence makes no sense if a. = oo or 
Goo = —00. The symbols oo and —oo are not real numbers, so formal 
inequalities such as Ja, — co| < ¢ have no meaning. 

Nonetheless, it is useful to be able to study sequences that “ap- 
proach” oo or —oo. Such sequences diverge (i.e., do not have a real 
limit), but they still enjoy some special properties of convergent se- 
quences. 


Definition 4.37. Let (a,) be a real sequence. We say (a,) diverges 
to oo, denoted (a;,) — co, if the following condition holds: 


For every real number M, there exists a natural number N 
such that if k > N, then a, > M. 


We say (az) diverges to —co, denoted (a,) + —o, if: 


For every real number M, there exists a natural number N 
such that if k > N, then a, < M. 


Example 4.38. The sequence a, = k diverges to infinity: By the 
Archimedean property, if M € R, there exists a natural number N 
such that N > M. Ifk >N,thena,=k>N>M. 


Example 4.39. Fix x > 1. The sequence a, = x* (see Example 4.4) 
diverges to infinity. To see this, note that « = 1+ u for some u > 0. 
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By Theorem 2.26, 1+ ku < x* = a, for all k > 0. Fix M ER, and use 
the generalized Archimedean property to choose a natural number N 
such that Nu > M. If k > N, then 


M<Nu<1+Nu<1+ku< ac = ay. 
Since M was an arbitrary real number, (x”) > oo. 


Remark 4.40. If (a,) is a real sequence that is eventually non- 
decreasing, then either (a,) is bounded above (hence convergent to 
a finite limit), or not bounded above (hence divergent to oo). 

Analogous remarks hold for a real sequence that is eventually non- 
increasing. Consequently, an eventually monotone sequence always has 
an extended real limit. 


Theorem 4.41. Assume (a,x) > 00 and (by) 4 bx with by real. Then 
(i) (a, + d,) 00. 

(ii) If boo > 0, then (agbp) 4 00. Tf boo <0, then (axby) > —Oo0. 

(iii) Ifa, #0 for all k, then (b,/ax) — 0. 


Proof. (i) Since a convergent sequence is bounded (Proposition 4.23) 
and (b,) — bo, there exists a real number B > 0 such that |b,| < B 
for all k. Let M be arbitrary. Since (a,) — oo, there exists an N such 
that if k > N, then a, > M + B, which implies 


ay, + by > ay — || > (M+ B)-B=M. 


Since M was arbitrary, (a, + 6.) — oo. 

(ii) Assume b,, > 0. Taking ¢ = b,./2 > 0, there exists an N; such 
that ifk > N,, then |b,—b.| < ¢ =b,./2. Rearranging gives b,,/2 < by 
for k > Nj. 

Fix M arbitrarily. Since (a;) — oo, there exists an N > N, such 
that if k > N, then a, > 2M/b. But this implies 


and since M was arbitrary, (a,b,) — oo. To handle the case b, < 0, 
multiply appropriately by —1 in the preceding proof. 

(iii) Suppose a, # O for all k, so the quotient sequence (b;/a;,) is 
defined. As in (i), let B > 0 be a bound for |b;|. Fix ¢ > 0 arbi- 
trarily. Since (a,x) — oo, there is an N such that if k > N, then 
a, > B/e, which implies by/a, < B(e/B) = €. Since ¢ > 0 was arbi- 
trary, (b,/ax) > 0. 
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Remark 4.42. Theorem 4.41 may be interpreted as assigning values to 
certain arithmetic expressions containing infinity: If L > 0 is real, then 


Coss Te = 00; Oo (EL) = kee, +1 joo =. 
Easy modifications of the preceding arguments establish that 
CO +0 =O, —-0O —- 0c = —O, oo - 00 = E00. 


However, oo and —oo are not real numbers, and the preceding “equa- 
tions” must be understood as theorems about limits. By contrast, the 
following expressions are undefined, in the sense that their value de- 
pends on the sequences used to approximate them: 


00 — 00, 0 - (400), 00/0, 0/0. 


Consequently, care is required when manipulating algebraic expressions 
involving oo. For example, it is true (in the “limited” sense above) that 
1+0co = o, but not legitimate to subtract oo, “deducing” that 1 = 0. 


4.2 Subsequences 


Definition 4.43. An index sequence is a strictly increasing sequence v 
of natural numbers, i.e., v(k) € N and v(k) < v(k +1) for all k. 


Two useful properties are easily verified by mathematical induction. 
Lemma 4.44. Let v be an index sequence. 
(i) [fk <k’, then v(k) < v(k’). 


(ii) k <v(k) for all k, and if the inequality is strict for some ko, then 
the inequality is strict for allk > ko. 


Definition 4.45. Let a be a real sequence and v an index sequence. 
The sequence b defined by bz = a,x) is called a subsequence of a. 


Remark 4.46. In words, a subsequence of (a,,) is a sequence obtained 
by selecting an infinite number of terms @,(1), Qv(2), ---, Gv(k)) «++ IN 
their original ordering, i.e., subject to v(1) < v(2) < +++ <u(k)<.... 


Example 4.47. The subsequence (a9), for which we take v(k) = 2k, 
consists of the even terms of (a,). The subsequence (a2,41), taking 
v(k) = 2k + 1, consists of the odd terms of (a,). 
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Example 4.48. Let (an,)°2,5 be a real sequence. For each N in N, 
the subsequence (dn) y = (Gn4r)R9 is a tail of (a,), obtained by 
discarding the terms ag, ..., @y_1. Here v(k) = N+k. 


Remark 4.49. Convergence of a sequence is determined solely by con- 
vergence of an arbitrary tail; intuitively, prepending or omitting finitely 
many terms cannot change the convergence or divergence of a sequence. 


Remark 4.50. If some tail of a sequence has a property X, we say 
the original sequence is “eventually X”. Terms such as “eventually 
non-decreasing” have already been introduced. Similarly, we might say 
a sequence is “eventually positive”, “eventually no larger than 1 in 
absolute value”, or “eventually constant” 

Conditions such as “eventually bounded” or “eventually conver- 
gent” are syntactically “legal”, but carry no meaning, because a tail 
cannot be bounded, unbounded, convergent, or divergent unless the 
original sequence already possesses the same property. 


Proposition 4.51. Let (a,) be a real sequence that converges to dou. 
Tf (bi) = (Qv(n)) 18 an arbitrary subsequence, then (by) — deo. 


Proof. Fix ¢ > 0 arbitrarily, and pick an index N such that if n > N, 
then ja, —a.| < ¢. If k > N, then v(k) > N by Lemma 4.44, so 
\bg = @co| = |Quik) — Goo| << E. 


Definition 4.52. Let a be a real sequence. An index n is a peak point 
of aif adm» <a, for all m > n. 


Remark 4.53. Intuitively, a peak point is a location n from which, 
standing at height a, and looking to the right, you can see all the 
way to infinity. 


' 


Wy 


‘ a we EE Ee ON Oe ee ee 
BV VV 4 4\/6 V8 W 10 12 “14 © 16 © 18 © 20 


Example 4.54. If a, = (—1)"4/(4+-n), then every even natural num- 
ber is a peak point. (Arrows indicate unobstructed lines of sight.) 
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Example 4.55. A sequence a is non-increasing if and only if every 
natural number is a peak point of a. 

If a is non-decreasing, then a has no peak points. 

If a is unbounded above, then a has no peak points. 


Theorem 4.56. Every real sequence has a monotone subsequence. 


Proof. We consider two cases: The sequence a has infinitely many peak 
points, or only finitely many. In each case, we construct a monotone 
subsequence recursively. 

(Infinitely many peak points). Let v(1) be a peak point. Now let 
m > 1, and assume inductively that we have constructed peak points 
v(1) < v(2) < +--+ < v(m). Since a has infinitely many peak points, 
there exists a peak point v(m-+ 1) > v(m). The subsequence (a, %)) is 
non-increasing: By definition of a peak point, a,(%41) < a, x) for all k. 


(Finitely many peak points). Since there are only finitely many 
peak points, there exists an integer v(1) that is greater than every peak 
point. Now let m > 1, and assume inductively that we have constructed 
indices v(1) < v(2) <--- < v(m) such that aya) < aya) < +++ < Gym): 
Since v(m) is not a peak point, there exists an index v(m-+ 1) > v(m) 
such that dy(m) < Qyim+1). This completes the recursive step. 

The subsequence (a,(x)) is increasing by construction. 


Corollary 4.57 (The Bolzano-Weierstrass theorem). Every bounded 
real sequence has a convergent subsequence. 


Proof. Let a be a bounded sequence. By the theorem, there exists 
a monotone subsequence (a,(,)). But a bounded, monotone sequence 
converges by Theorem 4.28. 


4.3 Cauchy Sequences 


In order to prove from the definition that a real sequence (a;) con- 
verges, the correct “candidate” limit a. must be known. In practice, 
unfortunately, the limit is not known. The “Cauchy criterion” refor- 
mulates the definition of convergence in a way that refers only to the 
terms of the sequence itself. 


Definition 4.58. A real sequence a is a Cauchy sequence if the follow- 
ing condition holds: 


For every ¢ > 0, there exists an index N such that if k and 
k' > N, then jay — az| < e. 
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Remark 4.59. Exchanging k and k’ has no effect on |ay — ax|, so (as 
dictated by convenience) we may assume without loss of generality that 
ki > hor that kh -= bh 

Instead of specifying that k’ > k, we often write k’ = k +m with 
m a positive integer. The “Cauchy predicate” becomes “If k > N and 
m > 0, then |ap4m — az| < ©”. 


Theorem 4.60. Let (a,) be a real sequence. Then (ay) converges to 
some real number ax if and only if (ax) is a Cauchy sequence. 


Proof. (Convergent implies Cauchy). Assume (a,) — doo, and fix ¢ > 0 
arbitrarily. There exists a natural number N such that if k > N, then 
|Ak — Aoo| < €/2. Consequently, if k and k’ > N, then 


|an — On| < lag — Aoo| + [doo — ag] < €/2 + 6/2 =e. 


Since ¢ > 0 was arbitrary, (a;) is Cauchy. 


(Cauchy implies convergent). The proof proceeds as follows. We 
first prove that every Cauchy sequence is bounded. By the Bolzano- 
Weierstrass theorem, a Cauchy sequence has a convergent subsequence. 
Finally, we prove that a Cauchy sequence having a convergent subse- 
quence is itself convergent to the same limit. 

Taking ¢ = 1 in the Cauchy criterion, there is an index N such that 
if k and k’ > N, then |ay — ax] < 1. In particular, ja, — ay| < 1 for 
all k > N. Let M = max(|aol, |ai|,..., |anv—1|, |an| +1). Just as in the 
proof of Proposition 4.23 (ii), it follows that |a,| <M for all k. 

Since the Cauchy sequence (a,) is bounded, the Bolzano- Weierstrass 
theorem guarantees there is a subsequence (av(K)) converging to some 
real number aq. To complete the proof, it suffices to show (ag) > doo. 

Fix ¢ > 0 arbitrarily, and pick an index N, such that if k > Nj, 
then |ay(%) — Goo| < €/2. Now use the Cauchy criterion to pick N > Ny 
such that if k and k’ > N, then |az — ax| < €/2. 

Since v(N) > N, we have |a,,w) — do.| < €/2, and |a, — ayny| < €/2 
for all k > N. By the triangle inequality, if k > N, then 


lan — Gao| < lag —arin)| + |@uiw) — @e0| < €/2 +e/2 Sc. 


Since ¢ > 0 was arbitrary, (ax) > doo. 
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4.4 Infinite Series 


Definition 4.61. Let (a,)?29 be a real sequence. We define the se- 
quence (s,,) of partial sums as follows: 


n 
Sn = ) Ap = Ap + ay + dQ + +++ + Gn. 
k=0 


Precisely, the partial sums are defined recursively: 
So = a, Snti = Sn+4ni1 forn> 0. 


The sequence (a,) is summable if the sequence of partial sums con- 
verges to a finite limit s. In this event, we write 


n (oe) 
s= lim s, = lim 5 ar => Qk. 
Noo noo 
k=0 k=0 


The expression on the right is called the infinite series with terms or 
summands ay, and is said to converge to s. 

If the sequence of partial sums does not converge, we say the infinite 
series }>,, a, diverges. 


Remark 4.62. Think of a real sequence as an infinite list of credits (non- 
negative terms) and debits (negative terms). The partial sums are the 
“running totals” of the terms taken in a specified order. The sum of a 
series, if it exists, is the net value in the limit, when “all the terms have 
been added” in their specified order. 


Remark 4.63. Since 8n41—Sn = Gn41, if ag > 0 for all k, the sequence of 
partial sums is non-decreasing. More generally, if only finitely many a, 
are negative, the sequence of partial sums is eventually non-decreasing. 
Similar remarks hold if at most finitely many summands are positive. 


A few general properties are useful to record before we turn to 


examples. 


Theorem 4.64. Let (a,) and (by) be summable real sequences, and 
assume c€ R. The sequences (ax + by) and (cax) are summable, and 


S (ax + be) = San + >" be, S- (can) =c) ay. 
k=0 k=0 k=0 k=0 k=0 
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Proof. If (s,) and (t,) denote the respective sequences of partial sums 
of (ax) and (bz), then (s, + t,) and (cs,) are the respective partial 
sums of (a, + b,) and (ca;,). The theorem follows immediately from 
Theorem 4.31. 


Proposition 4.65. Let (a,) be a real sequence. For all natural numbers 
N andm, we have: 


N+m N+m 
SNim — 8N = S- az, and therefore |Snim— Sn| < oy |ax|. 
k=N+41 k=N+1 


Theorem 4.66. A real sequence (ax) is summable if and only if the 
sequence of partial sums is Cauchy. In particular, if (ax) is summable, 
then (az) + 0. 


Proof. The first assertion is immediate from Theorem 4.60. For the 
second, fix ¢ > 0, and choose an index N such that if k and k’ > N, 
then |s,—s,| < ¢. In particular, ifk > N, then |ag41| = |sx41—5%| < ©. 
This means (a,) — 0. 


Example 4.67. Let a 40 and r be real numbers. The infinite series 


CO 
y ar® =at+ar+ar?+are+... 
k=0 


is called the geometric series with first term a and ratio r. 

If |r| > 1, then Jar*| = |a||r|* does not converge to 0, see Exam- 
ple 4.39, so the geometric series diverges. 

Suppose —1 < r < 1. The key to analyzing the geometric series is 
the algebraic observation that multiplying a partial sum by r “shifts” 
the summands: 


—— S— ark =atar+ar?+ar?+---+ar", 
k=0 
n+1 
r= Se ar®* = ar+ar?+ar ar” + ar"! 
k=1 


Subtracting the second line from the first, (1—1)s, =a—ar"*!. Since 
r #1, this equation can be solved for sy: 


n nt+1 

= ke | | | | | _all-r ) 

Bie ar® =a+ar+ar* +ar?+---+ar" = ———_., 
k=0 


l-r 
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the finite geometric series formula. (This formula is correct for all real r 
other than 1.) 


By Example 4.4, (r”) > 0 since -1 <r < 1. Theorem 4.31 implies 


ee Ok A =r) a(1-lim,r"*!) a 
Dee gs eee l-r i l-r a 


Example 4.68. The so-called harmonic series 


— i. a 1 

= eee 
k oe" 23 n 

k=1 


introduced in Example 4.6 has terms that decrease to 0. Nonetheless, 
the harmonic series diverges. ‘To prove this, it suffices to show the 
partial sums are unbounded. 

Each of the first two terms is at least 1/2. The next two terms, 
1/3 and 1/4, are each no smaller than 1/4, so their sum is greater than 
Dt 470 

The next four terms, 1/5, 1/6, 1/7, and 1/8, are each at least 1/8, 
so their sum is greater than 4-1/8 = 1/2. 

Similarly, the next eight terms, 1/9, 1/10, ..., 1/16, sum to at least 
8-1/16 = 1/2, the sixteen terms after that sum to at least 1/2, and so 
on ad infinitum. 


gm gm 
1 j: Det 
—_ > — = 
DS; ee Do. oe = ae =o 
k=2™-141 k=27-141 
Consequently, 
2" n PA n 
1 i iF n 
sl >14 =1+-, 
Da De pain 
k=1 m=1 k=2m-141 m=1 


which is unbounded by the Archimedean property. 
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Tests for Summability 


No single, easily-applied test determines whether a general infinite se- 
ries is convergent or divergent. Instead, we develop techniques to handle 
special classes of series. 


Lemma 4.69. Let (a,) and (by) be real sequences, and let (s,) and 
(t,) denote the sequences of partial sums of (ay) and (by) respectively. 
If (by) is summable, and if there exists a natural number No such that 


[Sin! — Sm| < |tm: —tm| whenever m’ >m > No, 
then (az) is summable. 


Proof. If (by) is summable, i.e., if the sequence (t,,) of partial sums 
converges, then (t,,) is Cauchy. Thus, for every ¢ > 0, there exists an 
index N > No such that if m’ > m > N, then |tm —tm| < ¢. By 
the hypotheses of the lemma, if m’ > m > N, then |8m: — 5m| < € as 
well. This implies the sequence (s,) is Cauchy, hence convergent by 
Theorem 4.60. 


Theorem 4.70 (The comparison test). Let (a,) and (bg) be non- 
negative real sequences, and assume az < by for all but at most finitely 
many k. If (by) is summable, then (az) is summable. Contrapositively, 
if (ay) is not summable, then (by) is not summable. 


Proof. Let (s,) and (t,) denote the sequences of partial sums of (a) 
and (b,) respectively. By hypothesis, there exists an index No such that 
ay < by for all k > No. If n > No and m > 0, then 


n+m n+m 
[Sian _ Sy = Ss ap S S° by, = aaa = bel 
k=n+1 k=n+1 


The theorem follows from Lemma 4.69. 


Absolute Summability 


Theorem 4.71. Let (a,) be a real sequence. If the sequence (|axz|) of 
absolute values is summable, then (ax) is summable, and 


oo co 
da] S Dla 
k=0 k=0 
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Proof. Let (s,) and (t,) denote the sequences of partial sums of (a,;) 
and (|a,|) respectively. By the triangle inequality, 


n+m n+m 
pees = Sn = S- ak < Ss" |ax,| = genes =? tl 
k=n+1 k=n+1 


for all natural numbers n and m. If (t,) converges, then (s,,) converges 
by Lemma 4.69. Since 


n 
dou 
k=0 


the inequality in the theorem holds by Proposition 4.35. 


< S- lax| for alln >0 
k=0 


Definition 4.72. A real sequence (ax) is absolutely summable if the 
sequence (|a,|) is summable. 

If (ax) is summable but (|a;|) is not, then (a,) is conditionally 
summable. 


Remark 4.73. Alternatively, an infinite series >, a, is absolutely con- 
vergent if )*,, |ax| is convergent, and is conditionally convergent if S>, ax 
converges but 5°, |a,| diverges. 


Definition 4.74. Let (a,) be a real sequence. The sequences (aj) and 


(a, ) defined by 


ag| + @ : ap| — @ 
Ge Ge) eee a, = —min(a,z,0) = po 
are called the sequence of positive terms of (ax) and the sequence of 
negative terms of (ax), respectively. 


Example 4.75. If a, = (—1/2)* for k > 0, then 


k=|0 (2 3 4 5 
a, =|1 —1/2 1/4 -1/8 1/16 —1/32 
jax/=|1 1/2 1/4 1/8 1/16 1/32 
at =] 1 0 1/4 0 1/16 0 
a=|0 1/2 0 1/8 0 1/32 


Remark 4.76. Each sequence (a; ) is non-negative, so each is summable 
if and only if its sequence of partial sums is bounded. Further, 


dp =a, —a;,, en) =O, 58 G2, 


and 0 < a; < |a,| for all k. 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


74 CHAPTER 4. SEQUENCES 


Proposition 4.77. Let (a,) be a real sequence. 


(i) (ax) is absolutely summable if and only if both sequences (a; ) and 
(a, ) are summable. 


(ii) If (ax) is conditionally summable, then both sequences (a) and 


(a, ) are non-summable. 


Proof. (i) If (a;,) is absolutely summable, i.e., if (|a,|) is summable, 
then each sequence (a7) is summable by comparison with (|a,]). 
Conversely, if the sequences (aj) and (a; ) are both summable, then 
({ax|) = (a; + a; ) is summable by Theorem 4.64. 
(ii) By hypothesis, (a,) is summable but (|a,|) is not. If either of 
(a) were summable, then (|az|) would be as well by Theorem 4.64, 


since |a,| = 2a, F ay. Contrapositively, (a;) is not summable. 


The Ratio Test 


Theorem 4.78 (The ratio test). Let (a,) be a real sequence. If the 
limiting ratio 


Ak 
exists, and if p <1, then >>, ax is absolutely convergent. 


Proof. Let r = (14+ p)/2, so that p < r < 1, and put ¢ =r — p, see 
diagram. Since |az41/ax| — p, there exists an index N such that if 
k > N, then 

Ak+1 


=p pet <1: 


p-eé r=pt+e 


0 p 1 


Rearranging, |a%41| < |a,|r for all k > N. By induction on m, 
lanim| < lan|r™ for all m > 0. 


Consequently, we have 


(oe) [o-e) (oe) 
S- lanl = $5 lan+ml < lawl Sor. 
k=N-+1 m=1 m=1 


This upper bound is a convergent geometric series, so 5°, |a,| converges 
by comparison. 
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Corollary 4.79. Let r be a real number with |r| <1. For each positive 
integer m, the series \>,k™r* is absolutely convergent. Consequently, 
the sequence (k™r*) converges to 0, and in particular is bounded. 


Proof. Setting a, = k™r*, we have 


= jim (1 - (1/k)) a ee ef eal 


(k As Leet 
kmrk 


so )>,, k™r* is absolutely convergent by the ratio test. The remaining 
assertions are immediate. 


Alternating Series 


Definition 4.80. If (a,) is a sequence of positive terms, an infinite 
series + )>,(—1)*ax is said to be alternating. 


Theorem 4.81 (The alternating series test). Jf (aj) is a non-increasing 
positive real sequence, and if (ax) — 0, then the alternating series 
yo .(—1)*ax converges, and 


CO 


>) Cla. 


k=n+1 


& [Grist | 


Proof. Assume for definiteness that the first summand, say ag, is posi- 


tive, and let 
3 k 
Sn = (—1) Ak. 
k=0 
If n is an arbitrary even index, then sn42 = 8) — Gn41+Gn42 < Sn since 
Gn42 < Gn41. With the same n, 8n43 = Sn41 + Ante — Gn4i3 > Sn41- 
Writing n = 2m and combining these inequalities, 


Sam+1 S Sam+3 S Sam42 < Sam 
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for all m > 0. Consequently, the even partial sums form a non- 
increasing sequence that is bounded below by every odd partial sum, 
and is therefore convergent to a real number + = inf, $2. Similarly, 
the odd partial sums form a non-decreasing sequence that is bounded 
above by every even partial sum, and is therefore convergent to a real 
number ¢@~ = sup,,, Sam+41- Since (ax) > 0 and 


S55 Git = ae 
for all m > 0, we have (+ = ¢-, ie., the sequence of partial sums 
converges to some real number ¢, and 


(oe) 


S> (-1*a; 


k=n+1 


= |€— Sn] S |ansil- 


Exercises 


Exercise 4.1. Consider the real sequence defined by az = kD". Show 
that (a;) has a subsequence converging to 0 and a subsequence diverging 
to oo. 


Exercise 4.2. Construct a sequence a of positive real numbers such 
that a > 0 but a is not eventually non-decreasing. 


Exercise 4.3. Let ¢), 2, ..., &m be arbitrary distinct real numbers. 
Prove there exists a real sequence a such that for each i = 1,...,m, 
some subsequence of a converges to ¢;. 


Exercise 4.4. Let (a;) be a sequence of positive real numbers, and let 
by, = 1/axz. Prove that if (a,) > 0, then (b,) — oo. 


Exercise 4.5. Let (a,) be an integer sequence, i.e., a, is an integer 
for all k. Prove that (a,) converges if and only if (a,) is eventually 
constant. 


Exercise 4.6. Let (a,) and (b,) be real sequences. Prove that if (b;) 
is bounded and (az) + 0, then (azb,) > 0. 


Exercise 4.7. (The squeeze theorem) Suppose (a;), (b;,), and (c,) are 
real sequences, and assume there exists an No such that if k > No, then 
Ap < Ch < by. Prove that if (a,) and (b,) converge to the same limit L, 
then lim, cz exists is equal to L. 
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Exercise 4.8. Let (a,) be an absolutely summable sequence. Prove 
the sequence (az) is absolutely summable. 


Exercise 4.9. If (a;,) and (b,) are real sequences, we may define a new 
sequence (c;,) by “shuffling” the two given sequences, i.e., Co, = ax and 
Copii = by Tor kh > 0, 

Write out the first six terms of (c,). Prove that (c,) converges if 
and only if (a,) and (by) converge to the same limit. 


Exercise 4.10. Let (a;) be a real sequence and a, a real number. 
Consider the following conditions: 


(i) For every ¢ > O, there exists an N such that if k > N then 
|Ap — Ago| < €. 


(ii) There exists an N such that for every « > 0, if k > N then 
|dk — Aco| <€. 


Are these conditions logically equivalent? If so, give a proof. If not, 
find a “familiar” condition equivalent to (ii), and give an example of a 
sequence satisfying (ii) but not (i). 


Exercise 4.11. Let (a;) be a real sequence and a, a real number. 
Consider the following conditions: 


(i) There exists an ¢ > 0 such that for every integer N > 0, if k > N 
then jay — ado| < €. 


(ii) For every integer N > 0, there exists an ¢ > 0 such that if k > N 
then jay — aa| < €. 


Are these conditions logically equivalent? If so, give a proof. If not, 
find a “familiar” condition equivalent to (ii), and give an example of a 
sequence satisfying (ii) but not (i). 


Exercise 4.12. Let a be a sequence of positive real numbers, and 
assume a —> 0). 


(a) Prove that for every natural number m, there exists a natural 
number n > m such that an < dm. 


(b) Prove that a has a strictly decreasing subsequence. Suggestion: 
Use part (a) to construct a decreasing subsequence inductively. 
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Exercise 4.13. Let a be a real sequence that is not bounded above. 


Prove there exists a strictly increasing subsequence. 


Exercise 4.14. Let a be a sequence that is not eventually constant. 


(a) Prove that if a is non-increasing, then a has a strictly decreasing 


subsequence. 


(b) Use the proof of Theorem 4.56 to prove a has a strictly monotone 


subsequence. 


Exercise 4.15. Let a be a non-increasing sequence of positive real 
numbers, and assume a — 0. Prove there exists a positive, non- 


increasing sequence b such that b — 0 but (b,/az) > oo. 


Exercise 4.16. Let (a,)72, be a “digit sequence”, i.e., a sequence all 


of whose terms are integers between 0 and 9 inclusive. 


(a) Prove that the series 


Co 


10" 10 100 1000 — Pra 


k=1 
converges to a real limit between 0 and 1. 


Suggestion: The geometric series formula may be useful in obtaining 


an upper bound. 


(b) Prove that the digit sequences (5,0,0,...) and (4,9,9,9,...) give 


rise to the same sum in part (a). 


(c) Under what conditions do two distinct digit sequences define the 


same sum in part (a)? 


Suggestions: Let (a,) and (b;) be distinct digit sequences defining 
the same real number, and assume (i) a, = by for 1 < k < n, and 
(ii) Gy < by. How much smaller than b, can a, be? What can you 


say about all subsequent digits of each sequence? 


Exercise 4.17. Let (a,)?2, be a sequence all of whose terms are either 


0 or 2. Prove that the series 


Sos S4 2S, 
BP Be ee 


k=1 


converges to an element of the Cantor set kK. Conversely, show that 
every element of K can be expressed (in exactly one way) in this form. 
Suggestion: Consider how successive “digits” of x are related to the 


location of x with respect to the approximating sets K,. 
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Functions 


Definition 5.1. Let X and Y be non-empty sets. A function or map- 
ping f : X + Y (read “f from X to Y”) is a set f of ordered pairs 
(x,y) with the property that for each x in X, there exists exactly one y 
in Y such that (x,y) € f. 

If (x,y) € f, we write y = f(x) and call y the value of f at x. The 
set X is the domain of f; its elements are the “inputs” of f. The set Y 
is the target of f; its elements are “potential outputs” of f. 


Remark 5.2. Informally, a function f : X - Y is a “rule” assigning a 
unique element y in Y to each element x in X. In calculus, the set f 
is called the graph of f. 

Unlike the situation in calculus, a function is not merely a formula. 
For example, changing the domain by removing a single point defines 
a different function. 


Example 5.3. A real sequence is a mapping a: N > R. A subse- 
quence may be viewed as the result of “shrinking” the domain from N 
to a proper subset {v(k):k © N} = {v(1) < (2) <--+ <u(k) <...}. 


5.1 Examples of Functions 


Polynomials and Rational Functions 


Example 5.4. Let X be aset of real numbers. The function 1: X > X 
defined by u(x) = x for all x in X is called the identity function on X. 


Example 5.5. Let X be a set of real numbers. For each real number c, 
there is a unique constant function c: X — R defined by c(x) = c for 
all z in X. 


79 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


80 CHAPTER 5. FUNCTIONS 


Definition 5.6. Let f and g be real-valued functions with domain X. 
The functions f+g and fg with domain X are defined by the formulas 


(ftg)(@)=fle)to(x), — (F9)(2) = f(x) - g(x) 
for each x in X. These functions are called the pointwise sum, differ- 
ence, and product of f and g. 
If Z = {xin X : g(x) = 0} is the zero set of g on X, there is a 
pointwise quotient f/g defined by (f/g)(x) = f(x)/g(«) for all x in the 
set X \ Z, the natural domain of f/g. 


Example 5.7. Let ao, a1, a2, ..., G, be real numbers. The formula 
f(x) =a9 + a1” defines a linear function f: R— R. 

The formula f(x) = ao + ax + ax? defines a quadratic function 
f:R-R. 

Generally, the formula 


p(x) = ag + aye + age? + +++ + ana” 
= a x(ay | a (ay fe++ 4 | Gp lina! )) 
defines a polynomial function. If a, #0, we say p has degree n. 
The numbers do, @1, @2, ..., Gy are the coefficients of p. The leading 


term is the highest degree term having non-zero coefficient. 


Remark 5.8. Polynomial functions are the most general functions ob- 
tained from constant functions and the identity function . on R using 
only the operations of addition and multiplication. The second expres- 
sion above for p(x), called Horner’s form, entails at most n multiplica- 
tions and n additions. 


Example 5.9. Let 


p(x) = ao + at + age? +--- + an2”, 
q(x) = bo + bya + box? +--+ + bn a™ 
be polynomials, and let Z be the zero set of g on R. The formula 
| | Dott Non it n 
f(a) = p(x) — ao a,x - = : : — 
q(x) bg + bye + box? +--- + dye 


defines a rational function f:R\Z—>R. 
Example 5.10. The formulas 


fel= ae I= ayy 


define rational functions. The natural domain of f is the set R\ {+1}. 
The natural domain of g is R. 
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Patching 


In practice, a function may be defined by partitioning the domain and 
using different formulas on the various subsets. 


Example 5.11. Assume A C R. The characteristic function of A is 
the function v4: R — R defined by 


(x) 1 ifxeA, 
is — 
ne 0 ifedA. 


In words, y 4 inquires of each real number x, “Are you an element of A?” 
and returns 1 (yes) or 0 (no) accordingly. 


1 ° o——_—" o—o 
| 
| 
| 
| 


Ea) 


o—oA4 


The characteristic function of Q, the set of rational numbers, is 
known as the Dirichlet function. 


Example 5.12. Define f : [0,00) > R by 


x if << e, 
je {", ifl<z. 


A function of this type is said to be defined piecewise: The domain is 


divided into finitely many intervals, and an algebraic formula is given 
for each subinterval. 
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Example 5.13. Let [a,b] be a closed interval of real numbers. A func- 
tion f defined on [a, }] is a step function if there exist numbers {x;}"9, 
with 77 =a< 2, <---< 2, =0, such that f is constant on each open 
interval (x;_1,7;), namely there exist real numbers {y;}7_,, such that 
fle) = yelor- Gp Oe <a 


Example 5.14. The function f : [0,1] — R defined by 


1/2” if1/artl cae <1/2", 
igen ee / 
0 ie 0) 


is not technically a piecewise function or a step function because the 
domain has been divided into infinitely many subintervals. 


Function Decompositions 


Example 5.15. Let X be a non-empty set of real numbers, and let 
f :X +R bea function. We define the positive part ft and negative 
part f— of f by the formulas 


F(a) = max(f(x),0) = Het Me) 
i) = —min(f(a), 0) = We = 0) 


compare the discussion of absolutely summable sequences in Chapter 4. 
Each function is non-negative. 


Example 5.16. Let X be a set of real numbers that is “symmetric 
with respect to 0”, ie, —X = X. (See Definition 3.24.) A function 
g: X — Ris said to be even if g(—x) = g(x) for all x in X. A function 
g: X — Ris said to be odd if g(—x) = —g(x) for all x in X. 

Assume f : X — R is an arbitrary function, and define 


feven(t) = 5 (f(x) + f(-2)), 
foaa(z) = 3 (f(x) — f(—2)). 
These functions are easily checked to be even and odd (respectively), 


and to satisfy foven(Z) + foaa(z) = f(x). They are called the even part 
of f and the odd part of f. 
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Composition 


Definition 5.17. Let X, Y, and Z be non-empty sets of real numbers, 
and let f: X > Y andg: Y — Z be functions. The composition of g 
and f is the function go f : X — Z defined by 


(go f)(x) = g(f(x)) for all x in X. 


Two functions g and f are composable if the target of f is contained in 
the domain of g. 


Example 5.18. The polynomial functions f(x) = «+1 (“adding one”) 
and g(x) = x” (“squaring”) are composable (in either order), and 


(go f)(z) =g9(a@41) =(e@4 1) =27 42x41, 
(f og)(x) = f(x?) = 27 +1. 
Note that the order of composition matters in general. 


Example 5.19. Assume f : X — R. For each real number c, there 
is a function 7,.(z) = z —c. The composition g = fo7t:c+X 39R 
is defined by the formula g(z) = f(z —c) for all z inc+ X, ie., by 
g(c+x) = f(x) for all x in X. 


Definition 5.20. Let @ > 0 be a real number. A function f:R—>R 
is said to be periodic with period ¢, or ¢-periodic, if f(a + @) = f(x) for 
all real x. 


Remark 5.21. By an easy inductively argument, if f is periodic, then 
f(a + ne) = f(x) for every integer n. 


Example 5.22. The characteristic function yz is 1-periodic. 


Example 5.23. Let a < b be real, and put = b—a. If f: [a,b) 7 R 
is arbitrary, there exists a unique ¢-periodic function that agrees with f 
on |a,b). This periodic function is also denoted f : R > R, and is said 
to be obtained by extending by periodicity. 


5.2 The Action of Functions on Sets 


Image and Preimage 
Definition 5.24. Let f : X — Y bea function. If A CX, the set 
f(A) ={y in Y : y = f(z) for some zx in A} 
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is called the image of A under f. In particular, the set f(X) of values 
of f is called the amage of f. 
If B CY, the set 


7 (B) Stein Xf) eB} 


is called the preimage of B under f. 


Inversion 


Definition 5.25. Let f: X —~ Y andg: Y — X be functions. We 
say f and g are inverse functions if (go f)(x) = x for every x in X and 
(f og)(y) = y for every y in Y. 

In this situation, we denote g by the symbol f~!, read “f inverse”. 
A function f : X — Y is said to be invertible if there exists an inverse 
foi:YoXx. 


Remark 5.26. A function has at most one inverse: If f is invertible, 
then f~'(y) = x if and only if y = f(x), so the values of f uniquely 
determine the values of f~t. 

Procedurally, the inverse function “undoes” the action of f. For 
example, an equation y = f(x) is “solved” for x by applying f~! to 
both sides. The domain of f~! is the target of f, and vice versa. 

To say f : X — Y is invertible means that for every y in Y, there 
exists exactly one x in X such that y = f(x). We then have a map- 
ping g: Y — X defined by g(y) = x. Invertibility may therefore be 
separated into two useful criteria: 


Definition 5.27. A function f : X — Y is injective if f(a.) = f(x2) 
implies x, = x. Contrapositively, f is injective if x7; # x2 implies 
f(ai) A f(x), ie., if f takes distinct values at distinct inputs. 
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A function f : X — Y is said to be surjective if for every y in Y, 
there exists an x in X such that f(#) = y. In words, every possible 
output value 7s actually a value of f. 

Finally, f is bzjective if f is both injective and surjective. 


Remark 5.28. Let f : X — Y be a function, and assume y € Y. 

If f is injective, the equation y = f(x) has at most one solution, 
i.e., the preimage f~'({y}) contains at most one element for each y. 

If f is surjective, y = f(x) has at least one solution, i.e., the preim- 
age f—'({y}) is non-empty for each y. 

Thus, f is bijective if and only if y = f(x) has exactly one solution 
for every y in Y, if and only if f is invertible. 


Example 5.29. Define f : R > R by f(x) = x”. Suppose we wish to 
determine whether or not f is injective and/or surjective. 

For injectivity, the general strategy is to assume f(x,) = f(x) and 
either deduce that 7, = 2%, or find a specific pair of distinct inputs 
having equal output values. 

Here, x? = x3 if and only if 


0 =a} — x3 = (a, — 22)(41 + 22), 


which implies x; — %2 = O or 41 + x2 = 0. The second equation has 
solutions with 7, # x2, such as 7; = 1 = —%, so f is not injective. 

For surjectivity, let y be an arbitrary element of the target, and 
attempt to solve the equation y = f(x) for x in the domain of f. 

Here, we wish to solve x? = y for x, with y an arbitrary real number. 
By Lemma 2.22 (iv), x? > 0 for all real x. Consequently, the equation 
x? = —1 has no real solution; that is, y = —1 is not in the image of f, 
so f is not surjective. 


Example 5.30. Define g : (0,00) + R by g(x) = x. Since the domain 
of g differs from the domain of f in the preceding example, g and f are 
different functions even though they are defined by the same formula. 

Though g is not surjective for the same reasons as f above, g 1s 
injective: If g(z,) = g(x2) for some positive real numbers x, and 22, 
then either x; —22 = 0 or 41+ 2%. = 0. But since x, and £2 are positive, 
their sum is positive; thus 7; — x2 = 0, i.e., ry = Xo. 


Example 5.31. Define h : (0,00) — (0,00) by h(x) = x”. Since the 
target of h differs from the target of g in the preceding example, h and g 
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are different functions even though they have the same domain and are 
defined by the same formula. 

The function h is injective for the same reasons as g. At this stage, 
however, it is unclear whether or not h is surjective. At issue is whether, 
for arbitrary real y > 0, the equation 2? = y has a positive, real 
solution x. 

In school, you learned to write “x = \/y”, but this sidesteps the fun- 
damental issue of whether “,/y” is mathematically meaningful. (After 
all, “\/—1” is not meaningful in the real number system.) It does turn 
out that h is surjective, see Theorem 6.53. 


Definition 5.32. Let X be a non-empty set of real numbers. A func- 
tion f : X — Ris said to be strictly increasing on X if the following 
holds: 


If x < a’ are elements of X, then f(x) < f(z’). 


Lemma 5.33. Let n > 1 be an integer. The function f : (0,co) +R 
defined by f(x) = x", is strictly increasing. 


Proof. Use Theorem 2.18 (iii) and induction on n. 


Remark 5.34. As with sequences, there is a small raft of analogous def- 
initions for functions that are “non-decreasing”, “strictly decreasing” 
and so forth. For example, f is non-decreasing if the following holds: 


If x < 2’ are elements of X, then f(x) < f(z’). 


(Since the conclusion is automatic when x = 2’, the hypothesis may be 
expressed freely as x < x’ or x < 2’.) 

Computationally, an increasing function may be applied to both 
sides of a strict inequality, preserving the sense and strictness of the 
inequality. A non-decreasing function may be applied to both sides of 
an inequality, preserving the sense of the inequality. 

Remark 5.35. A strictly increasing function is injective: If 7, 4 xo, 


then without loss of generality we have x; < %2, so f(#1) < f(x2). 
Similarly, a strictly decreasing function is injective. 


Example 5.36. The reciprocal function f(«) = 1/2, defined for x 4 0, 
is invertible (indeed, f~! = f), hence injective. However, f is neither 
strictly increasing nor strictly decreasing: —1 < 1 and 1 < 2, but 
f(—1) < fC) (so f is not decreasing) and f(2) < f(1) (so f is not 
increasing). 
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Lemma 5.37. Let f : X — Y be strictly increasing and surjective. 
The inverse function f-':Y — X is strictly increasing. 


Proof. Let y < y’ be arbitrary elements of Y, and let « = f~!(y) and 
x’ = f-*(y’). If 2’ were less than x, then y' would be less than y because 
f is increasing; consequently, we have x < a’, ie., f~'(y) < fot(y’). 
Since y < y’ were arbitrary, f~! is increasing. 


Remark 5.38. An entirely similar argument shows that if f is strictly 
decreasing, then f~! is strictly decreasing. 


5.3 Cardinality 


Definition 5.39. Two non-empty sets X and Y are said to have the 
same cardinality if there exists a bijection f:X 3 Y. 


Example 5.40. Two finite sets have the same cardinality if and only 
if they contain the same number of elements. The act of “counting” 
elements of a set X of n elements determines a bijection from X to the 
“initial sequence” Y = {1,2,...,n} in the set Z* of positive integers. 


Remark 5.41. A finite set X does not have the same cardinality as 
any proper subset Y. However, every infinite set does have the same 
cardinality as some proper subset, as examples below demonstrate. 


Example 5.42. The set N of natural numbers has the same cardinality 
as the following proper subsets: 

The sttn+N={minN:m>n}={n,n+1,n+4+2,...}, with 
nm > 1 an arbitrary natural number. The function f : N—~ n+N 
defined by f(k) =n+k is a bijection, with inverse g(m) = m— n. 

The set 2N = {0,2,4,...} of even natural numbers. The function 
f(k) = 2k is a bijection from N to 2N. 

The set 2N+1 = {1,3,5,...} of odd natural numbers. The function 
f(k) = 2k + 1 is a bijection from N to 2N + 1. 


Example 5.43. The sets N and Z have the same cardinality. The 
function 


roe n/2 if n = 2k is even, 
— |-(l+n)/2 ifn =2k +1 is odd, 


is a bijection from N to Z. The set of even elements 2N is mapped 
bijectively by f to the non-negative integers, and the complementary 
set 2N + 1 is mapped bijectively by f to the negative integers. 
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Example 5.44. Let a < b be real numbers. The open intervals (0, 1) 
and (a,b) are in bijective correspondence under 


f(t) =a+t(b—a)=(1—-tha+th, 0<t<1. 


The inverse mapping is g(u) = (u—a)/(b— a) fora < u < b. Con- 
sequently, any two bounded open intervals have the same cardinality. 
(The same formulas define bijections between the closed intervals [0, 1] 
and |a, }].) 

The formula f(t) = 1/t defines a bijection from (0,1) to (1, 00). 
Example 5.45. The sets N and Q have the same cardinality. Each 
ordered pair (p,q) consisting of an integer p and a positive integer q is 
associated to a rational number, r = p/q. The set of all such pairs may 
be ordered in a list as indicated below. 


Ne 
OR 
SS\ 
vy? 
_— 


To obtain a bijection from N to Q, omit each pair (p,q) having a 
common factor greater than 1. The first ten values of this mapping are 
Os) So. (EL eS, 201 ea 
(ees 1) > =2, (-1,2) 2d —$, (1, 2) > s, (2, 1) > 2, 
(-3,1I) 4-3, (-1,3)¢-3, (,3)¢6 43, (3,1) 43, .... 
Definition 5.46. A set X is countable or countably infinite if X has 
the same cardinality as N, the set of natural numbers. We say X is at 

most countable if X is either finite or countable. 


Remark 5.47. The preceding examples show that the set Z of integers 
and the set Q of rational numbers are countable. Modifications of 
the arguments given show that a countable union of countable sets is 
countable. The set of ordered pairs (p,q) in Example 5.45 may be 
viewed as the union over g > 1 of disjoint “copies” of the integers. 
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Example 5.48. The set of polynomials with rational coefficients is 
countable. A linear polynomial a9 + a,x with rational coefficients cor- 
responds to a unique ordered pair (dao, a1) of rational numbers, so there 
are countably many such polynomials by the preceding remark. 

Inductively, a polynomial of degree n + 1 corresponds to a rational 
number (the top-degree coefficient) and a polynomial of degree n (the 
remaining terms). The set of polynomials of degree n + 1 with rational 
coefficients is therefore a countable union of countable sets, and hence 
is itself countable. 

Since there are only countably many possible degrees for a poly- 
nomial, the set of all polynomials (of arbitrary degree) with rational 
coefficients is a countable set. 


Definition 5.49. A real number z is said to be algebraic if there exists 
a polynomial f with integer coefficients such that f(x) = 0. A non- 
algebraic real number is said to be transcendental. 


Example 5.50. Every rational number is algebraic: If r = p/q is 
rational, the linear polynomial f(z) = gx — p has r as a root. 

Similarly, square roots of positive rational numbers are algebraic; if 
f(x) = qv? — p, then r = \/p/q is a root (granted that the square root 
represents a real number). 

Since a polynomial of degree n has at most n distinct real roots and 
the set of polynomials with integer coefficients is countable, there are 
only countably many algebraic numbers. 


Not all infinite sets are countable. Particularly, the set R of real 
numbers is uncountable. We prove this in two stages: 


Example 5.51. The set X = {(a;,) : a, = 0 or 1} of all (countably- 
infinite) integer sequences whose terms are all 0 or 1 is uncountable. 
Our method of proof is the Cantor diagonal argument. We will show 
that if f is an arbitrary mapping from N to X, then f is not surjective; 
there exists a sequence not in the image of f. 

If f: N > X is arbitrary, we may write f(n) = (Gnx)~2o for each 
natural number n. Define a sequence b in X by the formula by = 1—axrz; 
that is, take the kth term of b to be the “opposite” of the kth term 
of the sequence f(k). By construction, b 4 f(n) for every n; these 
sequences do not have the same nth term! In other words, b is not in 
the image of f. But f : N — X was an arbitrary mapping; we conclude 
that no mapping from N to X is surjective. 
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Example 5.52. The set R is uncountable. In fact, the subset X’ of R 
consisting of all infinite decimals whose digits are all either 0 or 1 is 
uncountable, because there is an obvious bijection between X’ and the 
set X of binary sequences in the preceding example. 

In Chapter 3 we saw that the set Q of rationals is dense in R: 
Between any two real numbers, there is a rational number. We can 
now see a bit more deeply the complexity with which the rationals sit 
inside the reals, since the set of irrational numbers has larger cardinality 
than the set of rationals. 


Example 5.53. The set of binary sequences is in bijective correspon- 
dence with the Cantor ternary set K’, see Exercise 4.17. The geometric 
idea is simple. Recall that the Cantor set is the intersection of sets Ky, 
each obtained by removing the middle third of each subinterval of K,,_1. 
Assume x € K, and imagine “zeroing in” on x by answering an infi- 
nite number of “yes-no” questions. The answer to each question tells 
us whether to pass to a left-hand or right-hand subinterval when we 
remove the middle third. 


In more detail, we know initially that « € Ko = [0,1]. If x is in 
(0, Ar set dg = 0; if x is in [3,1], set dg = 1. Inductively, assume we 
have constructed a finite sequence do, ..., @n—1, and we have located x 


in a particular component of K,,. This component is split into two 
subintervals in K,y4+1. If x lies in the left subinterval, take a, = 0; 
otherwise take a,, = 1. 


0 1 


ooo 4 k, 
00 01 10 11 
-——— -———_ -——_ r——1 Ko 
000 O01 010 O11 100 101 110 111 
ao 4 FS a ra riks 


Each x in K gives rise to a unique binary sequence, each binary 
sequence determines a unique element of AK, and these associations are 
inverse to each other. It follows that K is uncountable, cf. Exercise 6.17. 

Only countably many elements of K are endpoints of some K,. 
Each set K,, has only finitely many endpoints. The set of all endpoints 
in K is therefore a countable union of finite sets. 

Alternatively, the endpoints of K,, correspond to sequences that are 
constant after the nth term, see also Exercise 5.27, and there are only 
countably many such sequences. In any event, most elements of AK are 
not endpoints of one of the sets Ky. 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


5.4. POWER SERIES 91 


5.4 Power Series 


“Power series” constitute one of the most important tools in elementary 
analysis. Loosely, a power series is “a polynomial with infinitely many 
summands” . 


Definition 5.54. Let (a,)729 be a real sequence, and let x9 be a real 
number. The infinite series 


Saya = 7)" = a9 + a4(2 — 2) + aa(a — x9)? + a3(2 — 20)? + «e. 
k=0 


is called the power series with center xo and coefficients (ax). 


Remark 5.55. Let I be the set of real x at which the preceding power se- 
ries converges. When x = Zo every term (except possibly the first) van- 
ishes, and the series converges; that is, 79 € J. We will show presently 
(Theorem 5.63 below) that if the power series converges at some real 
number x # x, then the series converges absolutely at each point of 
the open ball with center xq and radius |x — xo|; that is, J comprises 
either a single point or an interval centered at x9 (possibly closed or 
half-open), called the interval of convergence of the power series. In J, 
the sum of the series defines a real-valued function f. 


Example 5.56. The geometric series 


co 


Sittaltacte tart... 


k=0 


converges if and only if |x| < 1, see Example 4.67. That is, the interval 
of convergence is J = (—1,1), and 


. 1 
LES pe = 
k=0 


Replacing x by —x gives the power series representation 


1 1 = 28: kk 
lta 1 — (—2) paw =e} Z 


on (—1,1). 
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Example 5.57. The algebraic identity 


1 1 1 1 seeks 
= i ) x ) 
l-7* 2\l-x 1+2 


may be checked by putting the right-hand side over a common de- 
nominator. If —1 < x < 1, however, this identity has a remarkable 
interpretation in terms of geometric series: 


7 =lt+ertae? +e tate +a te! ; 
—2 

1 2 3 4 5 6 7 
ie =l-r4+er-rt+xe-—-ert+nr-—-axe't+ b 

x 

1 

=1 + x? + a4 + 7° ++ : 

1-27? 


the third line is half the term-by-term sum of the first two lines! 

Generally, convergent power series can be added, subtracted, and 
multiplied by constants “just as if they were polynomials”, because of 
Theorem 4.64. 


Example 5.58. Let c# 0. By Example 5.56, 


1 1 he PE og 
Ch eee oe ~ae 


provided |a/c| < 1, i-e., on the interval J = (—|cl, |c|). Similarly, 


ao oe), (2)'= Sot on = (leh le). 


k=0 


Definition 5.59. Let xz) be a real number and 0 < R < o. A real- 
valued function f defined on Br(xo) is said to be real-analytic if f is 
represented on Br(x9) by a convergent power series, i.e., there exist 
coefficients (a,)729 such that 


(f= So ax(x —2o)* for |x — x9| < R. 
k=0 


Remark 5.60. Our use of the term “real-analytic” is slightly stronger 
than the “standard” definition, but is convenient for our purposes. 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


5.4. POWER SERIES 93 


Example 5.61. Let xo #4 0 be arbitrary. The reciprocal function 
f(x) = 1/z is real-analytic on B),,\(a). Indeed (compare Example 5.58 
with c= Zo), 


love) k 
1 1 1 xr — Xo 
= = =a 
x @t(e#-—2) Zo De ) ( Lo ) 


k=0 


provided |(% — x9)/xo| < 1, namely in the open ball of radius |29| 
centered at Zo. 


Remark 5.62. Suppose 


CO 


Gea= So axa 6) S09 Pale Sp) + OG =a)? Bes 


converges on some open ball Br(xo). Introducing z = x — 29, we obtain 
a real-analytic function f : (—R, R) > R defined by 


[o-@) 
fee y a,z” = ap tayz + aez* +a3z°4+.... 
k=0 


The domain of f is a symmetric interval, and g(x) = f(x— 0) for all x 
with |x — | < R. Moreover, since z is a “dummy variable”, we may 
as well call it x, and write f(x) = D>, azar’. 

The practical consequence is that in proving theorems about general 
power series, we may assume the center of the series to be 0, gaining 
notational simplicity without loss of generality. 


Theorem 5.63. Let (a,)?,) be a real sequence, to a real number. If 
the series )*,a,R* converges for some R #0, then the power series 


CO 
Sag as — 20)! 
k=0 


converges absolutely for every x with |x—2xo| < |R|. That is, the inter- 
val of convergence I contains the open ball Byp\(xo) = xo + (—|RI, |R]). 


Proof. By hypothesis, the sequence (a;R*) is summable, hence conver- 
gent to 0 by the vanishing criterion (Theorem 4.66). Proposition 4.23 
implies (a;R*) is bounded; there exists a real number M such that 


|a,R*| = |az|-|RIK <M for all k > 0. 
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By Remark 5.62, we may assume Xp = 0. Let x be an arbitrary number 
with |z| < |R|, and put p = |z|/|RI, so that 0 < p < 1 and |z| = |R|-p. 
We have 

Jaxa"| = lag] |a|* = lax] - [RIS + p® < Mop*. 


Since M p* is the general term of a convergent geometric series, (\a;,2°*|) 
is summable by the comparison test. 


Corollary 5.64. Let (a;) be a real sequence, xo real. There exists an 
extended real number R with 0 < R < co such that the power series 
> , ae(x — xo)" converges absolutely for all real x with |x — xo| < R, 
and diverges for all x with R < |x — xol. 


Proof. Consider the set J = {x in R: 3°, |a,| |z|* converges}, and put 
R=supZJ. Since 0 € J, we have 0 < R. Since |—z| = |z| for all real z, 
the set J is symmetric about the origin. 

Let x be areal number with |x| < R= sup J. By the definition of a 
supremum, there exists an r in J such that |x| <r. By Theorem 5.63, 
(—r,r) C J. Since x in (—R, R) is arbitrary, (—R, R) C J. 

Conversely, if R < || =r, the power series }>, a," diverges; if the 
series converged, Theorem 5.63 would imply that (—r,r) C J, contrary 
to the fact that R = sup J. 


Definition 5.65. The extended real number R in Corollary 5.64 is 
k 


called the radius of convergence of the power series }>, ax(x — 20)”. 
Remark 5.66. If R = 0, the condition |x — x| < R is empty, and 
the power series diverges for all « # 2. Similarly, if R = oo, the 
condition R < |x —xo| is empty, and the series converges absolutely for 
all real x. The corollary gives no information about convergence when 
|x — xo| = R. 


Theorem 5.67. Let (ax)?29 be a sequence of coefficients. If 


Ak+1 
Qk, 


lz — xo| lim ce 


oo 


1.e., the limit exists and is smaller than 1, then the power series 


CO 
Sag as — 20)! 
k=O. 


converges absolutely at x. 
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Proof. For each real x, a power series is an ordinary numerical series, 
with terms by = az(x — x%o)*. By the ratio test, if |bei1/be| > p < 1, 
the series converges absolutely. But by algebra, 

Ansi(% — 2)" 
Ax(X — Xo)* 


k-o0o 


Remark 5.68. The statement of Theorem 5.67 is convenient for many 
purposes, but the method of proof applies more generally to power 
series having some coefficients equal to 0. In general, let b, denote the 
kth term (which is a function of x), and apply the ratio test to the 
series }°, by. 


Example 5.69. The power series 


g2ktl 3 5 7 


d-1 “GkEDI ee Lat eee 


k=0 


converges for all real x, ic., R = oo. Here, by = (—1)ha?**1/(2k + 1)!, 


_1)k+1,.2k+3 | 
lim Pita = lim (ens : (2k + 1)! 
k-s00 | by, k00| (2k + 3)! (—1)ha2k+1 
x*(2k + 1)! cig 
= | = im = 0, 


and this is less than 1 for all real x. 


Example 5.70. The power series 


CO 
! 
y carta tae tay... 


k=1 


converges if and only if |z| < 1. First, if |x| > 1, the terms of the 
series do not approach 0, so the series certainly diverges. Otherwise, 
by = x™, 80 |bpsi/by| = oe “KY As k — oo, the exponent grows 
without bound, so |a*+)'-'| —; 0 by Theorem 4.18, and the power 
series converges by the ratio test. 


Exercises 


Exercise 5.1. Use the definition to find the even and odd parts of: 
(a) f(z) =3— 27 +5274 2°. (b) g(x) = xpo,1)(2)- 
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Exercise 5.2. For each function f given, sketch the graphs y = f(z), 
y = ft(a), and f~(x) on the same set of axes. 
(a) f(x) = 2. (b) f(x) = |2] — 1. (c) f(a) = a(x — 1)(a — 2). 


Exercise 5.3. Find the even and odd parts of p(x) = x(x — 1)”. Find 
the positive and negative parts of p; express your answer as a piecewise- 
polynomial function. 


Exercise 5.4. Let a < b be real numbers, and let X = (a, b)\{0} be the 
set of non-zero real numbers between a and 6. Find, with justification, 
the image of X under the reciprocal function f(x) = 1/2, assuming: 
(a) b <0. (Bo =O: (Cl. Ob. Celiac "0: (e) 0 <a. 
Exercise 5.5. Construct two bijections between the intervals (0, 1) and 
(0, 00), one increasing, the other decreasing. Suggestions: The rational 
function f(t) = 1/t maps (0,1) bijectively to (1,00), and g(t) =1-t 
maps (0,1) bijectively to itself. 

Exercise 5.6. Construct a bijection between the intervals (—1, 1) and 


(—oo, 00). (If necessary, you may use square roots to prove your func- 
tion is surjective.) 


Exercise 5.7. Let (a;) be a real sequence. In each part, there exists 
a unique function f : [0,00) > R satisfying the given condition as well 
as f(k) = a, for all natural numbers k. Write down “piecewise-type” 
formulas for f, and carefully sketch the graph of f on the interval [0, 10] 
if a, = (-1)*/(k +1). 


(a) The graph of f is a straight line segment on each interval [k, k+ 1]. 
(b) f is constant on each interval [k,k + 1). 


(c) f is constant on each interval (kh, k + 1]. 


Exercise 5.8. Consider the rational function f(z) = (14+ 2)/(1— 2). 
Calculate the compositions fo f, fo fof, and fofofof, giving the 
domain of each, and simplifying formulas as much as possible. 


Exercise 5.9. Let f: X — Y andg: Y > Z be bijections. Prove that 
the composition go f : X — Z is a bijection, and express the inverse 
of go f in terms of the inverses of f and g. 


Exercise 5.10. Let f be defined on all of R. 


(a) What simple geometric operation on the Cartesian plane converts 
the graph y = $f (2x) into the graph y = f(x)? 
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(b) Generally, if c > 1, describe the graph y = +f (cz). 


Exercise 5.11. Let A and B be subsets of R, and let y4 and yg be 
their characteristic functions. Establish the following: 


(a) 1—xX4 = Xaec, the characteristic function of A°. 

(b) min(x4, XB) = X4nB = XA°* XB. 

(c) max(v4, XB) = XauB = XA + XB — min(X4, XB): 
Exercise 5.12. This exercise characterizes step functions. 


(a) Fork =1,...,n, let J, be an interval, y; the characteristic function 
of J;,, and cz, a real number. Use Exercise 5.11 and induction on n 
to prove that 


(t) f(e)= Ss CkXK(X) 


is a step function on R. Sketch functions of the form cy; + C2x2 
for which the sets J, and J, are, or are not, disjoint. 


(b) Can every step function be written in the form (1)? If so, prove it; 
if not, what properties of the sets [;, need to be modified? 


(c) Is the representation from part (b) unique? If so prove it; if not, 
what properties of the sets [;, need to be modified? 


Exercise 5.13. For each of the following power series, write out the 
first four non-zero terms and find the radius. If the radius is positive and 
finite, cclenS whether or not the perce converges at either endpoint. 


oF Dye ©) ois a 


Exercise 5.14. Repeat the preceding exercise for: 
OO Lk OO 2k 0° 
x x 
y= b) So —. ee 
‘ k=1 k oY k=1 k . k=1 " 


Exercise 5.15. Repeat the preceding exercise for: 


OF a" (b) So la (c) So(- 


k=0 k=0 
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(0, 1) 


1 


p(t) = (x,y) 


Exercise 5.16. Let X be the set of points (x,y) 4 (0,1) in the plane 
satisfying 2? + y? = 1. Define a mapping p: R > X by joining (0, 1) 
to (t,0) by a straight line and letting p(t) = (x,y) be the point of 
intersection with the circle, see diagram. 


(a) Use similar triangles to find (x, y) in terms of t. Your answer should 
be a pair of rational functions of t. 


(b) Show that p is bijective, both geometrically and by finding a for- 
mula for p~', i.e., expressing ¢ in terms of x and y. 


(c) Prove t is rational if and only if x and y are rational. Conclude 
that if A, B, and C are positive integers satisfying A? + B? = C?, 
then there exist positive integers p and q such that C = p*+q?, and 
{A, B} = {2pq, p” — q’}, i.e., these two sets are the same. 


(d) Let f(t) = 1/t for t 4 0. Show that p-'o f op(z,y) = (x, —-y), 
reflection of the circle across the x-axis. 


(e) Let f(t) = (1+¢#)/( —?t) for t A —-1,0,1. Show similarly that 
p 'ofop(x,y) = (-y, x), the counterclockwise quarter turn of the 
circle, compare Exercise 5.8. 


Exercise 5.17. Let 
Dt) Oy" + Gye” Ree baye + ag; 
g(a) = ba” + ba ot ae +O 


be polynomials with real coefficients, and suppose m < n, i.e., the 
degree of q is less than or equal to the degree of p. 


(a) Show that there exist polynomials d(x) and r(x) with real coefh- 
cients such that (i) p(a) = d(x)q(x)+r(z) and (ii) the degree of r(z) 
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is strictly smaller than the degree of q(z). 


(b) Use part (a) to prove that if xo is real, then p(xo) = 0 if and only 
if (x — xq) divides p(x). 


Exercise 5.18. Let p and q be polynomials of degree at most n and 
having real coefficients. 


(a) Show that p+ q is a polynomial of degree at most n. If p and q 
both have degree n, does p+ q have degree n? 


(b) Show that if c is a real number, then cp is a polynomial of degree 
at most n. Is the degree of cp always equal to n? 


(c) Suppose rp < 41 < +--+ < £, are real numbers, and p(x;) = 0 for 
i=0,1,...,n. Prove that p(x) = 0 for all real x. 
Hint: Use part (b) of the preceding exercise, and proceed by induc- 


tion on n. 
Let (21, y1), (2, y2), ---, (@n, Yn) be points in the plane, and assume 
Ly < %y < +++ < ap. (That is, no two of the points lie on a vertical 


line; by renaming, we may assume the points are numbered from left to 
right.) The next few exercises outline the construction of the Lagrange 
interpolation polynomial, a unique polynomial of degree at most n — 1 
whose graph contains all n points. 


Exercise 5.19. Suppose n = 2; that is, we seek a polynomial of degree 
at most 1 whose graph (a line) passes through specified points (x1, y1) 
and (22, ye) with x, < 2p. 


(a) The formulas 


wv — Xr LL 


€o(x) = 


Ey(v) = 
i ) tie. Lo — 21 


define polynomials of degree 1. Show that e;(#;) = 1 if i = j and 


That is, e;(41) = 1 and e;(x2) = 0, while eo(x ,) = 0 and e2(x2) = 1. 


(b) Use Exercise 5.18 to prove the polynomial p(x) = y ,e1(x) + yoeo(z) 
has degree at most 1. Show that the points (x1, y1) and (22, y2) 
satisfy y = p(z). 
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Exercise 5.20. Suppose n = 3; that is, we seek a polynomial of degree 
at most 2 whose graph (a line or parabola) passes through specified 
points (21,41), (%2, ye), and (x3, y3) with x1 < rq < 23. 


(a) The formulas 


=(&—- La)\(U- 2X e€4(x) = A(z) 
file) = (© ~ a2)(@ ~ 23), 1(@) = Fy) 

=(%—-4,)\(4- 2 €2(v) = Ale) 
fo(x) = ( i)( 3)5 2(2) Folasy? 

= (%—2X1)\(X—- 2X €3(r@) = Isl) 
f(x) =a i)( 2), 3( f3(x3)’ 


define polynomials e; of degree 2. Show that e;(a;) = 1 if i = 7 and 
(b) Show the polynomial p(x) = yie1(x) + y2eo(x) + y3e3(x) has degree 
at most 2, and that the points (x1, y1), (%2, yz), and (x3, y3) satisfy 
y = p(z). 
(c) Use parts (a) and (b) to find the unique quadratic polynomial p(z) 


whose graph passes through the points (—1, y1), (0, yz), and (1, y3). 
Under what conditions does p(x) have degree less than 2? 


Exercise 5.21. Let (x1, y1), (¥2, y2), ---; (Ln; Yn) be points in the plane, 
and assume 21 < @ <-++: <IXp. 


(a) For each i = 1,...,n, the formulas 


fi(x) 


fi(w) = (w—2))...(@—4j-1)(U—Xj41)...("@-Fn), ei(x) = Fila)’ 


define polynomials e; of degree (n—1). Show that e;(x;) = Lifi = 
and e;(¢-) = O-1h 2 Fy: 

(b) Show the polynomial p(x) = y,e1(x) + yoeo(x) +--+ + Ynen(x) has 
degree at most (n — 1), and the points (2;, y;) satisfy y = p(z). 


(c) Suppose y = q(x) is a polynomial of degree at most (n — 1) and 
yi = g(a) fori =1,...,n. Prove that q(x) = p(x) for all real z. 
Hint: Apply Exercise 5.18 (c) to the polynomial p(x) — q(x). 


Exercise 5.22. Let f : R — R be periodic for some ¢ > 0. Prove 
that the even and odd parts of f are also (periodic. 
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Exercise 5.23. Let ¢ > 0. A function f : R > R is ¢-anti-periodic if 
f(a+é) = —f (a) for all real x. Prove that such a function is 2¢-periodic. 


Exercise 5.24. Let X be a non-empty set of real numbers satisfying 
—X = X, and let f be a real-valued function on X. 

Suppose there exists an even function FE and an odd function O 
on X satisfying f(x) = E(x) + O(@) for all x in X. Find formulas for 
E(a) and O(a) in terms of f. Use Example 5.16 to conclude that every 
function on X may be written uniquely as the sum of an even function 
and an odd function. 


Exercise 5.25. Let p(x) be a polynomial. 


(a) Let n > 0 be an integer, and let f(z) = x”. Show that f is an 
even function if and only if n is an even integer, and show f() is 
odd if and only if n is an odd integer. 


(b) Prove that p is an even function if and only if every summand has 
even degree, i.e., if and only if there exists a polynomial qg such that 
p(x) = q(x?) for all real zx. 

Hint: You have formulas for decomposing p(x) as the sum of an even 
and odd function, and by the preceding question this decomposition 
is unique. 


(c) Prove that p is an odd function if and only if every summand has 
odd degree, i.e., if and only if there exists a polynomial q such that 


p(x) = xq(x?) for all real x. 


(d) Generalize the conclusions of parts (b) and (c) to convergent power 
series whose domain is an interval symmetric about 0. 


Exercise 5.26. Let X be a non-empty set of real numbers such that 
—X = X, and let f and g be functions on X. 


(a) Prove that if f and g are both even or both odd, then fg is even. 
(b) Prove that if f is even and g is odd, then fg is odd. 
(c) Suppose f is even, and A is an arbitrary function defined on all 


of R. Is either composition f oh or ho f necessarily even? Give a 
proof or counterexample. 
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Exercise 5.27. Let K be the Cantor set. By Exercise 4.17, there is a 
bijection between K and the set of sequences (a,)72, with a, = 0 or 2 
for all k, since each real number x in K is expressed uniquely in the 


form = 
_ ae a1 a2 ~~ a3 = 
= 3 tao tag tee dy = 0 or 2. 


Show that x is an endpoint of the set K,, if and only if the corresponding 
sequence (ax) is eventually constant; specifically, a, = 0 for all k >n 
or a, = 2 for all k > n. 


Exercise 5.28. In the notation of the preceding exercise, let x in K 
correspond to the sequence (a,) of Os and 2s. Set b, = ax/2 (so that 
(b,) is a sequence of Os and 1s), consider the infinite series 


be bn 5 bic be 
5 Par igg. tt 


and show that y is the general element of [0,1]. That is, there is a 
surjective mapping f : K — (0, 1]. 


Exercise 5.29. Every real number x has a unique non-terminating 
decimal representation. (For example, 1/2 = 0.49.) The decimal of x 
contains the digit 0 either finitely many times, or infinitely many times, 
depending on x. Define the function f : R — R by 


f(a) nif the decimal of x contains exactly n zeros, 
xX)= 


1 if the decimal of x contains infinitely many zeros. 


Prove that f is unbounded, and achieves the value —1, on every open 
interval. 


Exercise 5.30. Let A = Q/ [0,1] be the set of rational numbers 
between 0 and 1 (inclusive). 


(a) Construct a sequence (a,,) such that every element of A is a term 
of the sequence. 


(b) Prove that if 2 € [0,1], then there exists a subsequence (a, ,)) that 
converges to x. 
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Continuous Functions 


Throughout this chapter, X denotes a non-empty set of real numbers. 


Definition 6.1. Let f : X > R bea function, and x = (z;) a sequence 
in X, i.e., a real sequence such that 7, € X for all k. We define the 
image sequence y = (yz) by setting y, = f(x,) for each k, namely, by 
applying f to the terms of (zx). 


Example 6.2. Suppose f(x) = 1/zx for x 4 0. 
If x, = (k+1)/k for k > 1, then yx = k/(k +1). 
If #1) ki then gp — k: 
If x, = (—1)*/k, then yz = (—1)*k. 


Example 6.3. The signum function sgn : R \ {0} > R is defined by 
(x) x 1 if0<qa, 
sen(x) = — = 
° jz] )-1 if2<0. 


If x, =1/k for k > 1, then y, = 1. 
If x, = (—1)*/k, then y, = (—1)*. 


6.1 Continuity 


Definition 6.4. Let f : X — R be a function, and assume x € X. We 
say f is continuous at x if the following condition holds: 


For every sequence (x) in X that converges to x, the image 
sequence (f(2,)) converges to f(z). 


If f is continuous at x for each x in X, we say f is continuous on X. 


103 
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Remark 6.5. Computationally, f is continuous at x if and only if 
jim f(e%) = f(x) = f(tim ax) 


whenever (2;,) is a sequence in X and (x,) > @. 


Remark 6.6. If f : X — Ris continuous on X, and if A is a non-empty 
subset of X, then f is continuous on A, since every sequence in A is a 
sequence in X. 


The following trivial observation is useful enough to state explicitly. 


Lemma 6.7. The identity function is continuous on R. Every constant 
function is continuous on R. 


Theorem 6.8. Let f and g be continuous functions on X. The func- 
tions f +g and fg are continuous on X. If Z is the set of x in X such 
that g(x) = 0, then the quotient f/g is continuous on X \ Z. 


Proof. This amounts to little more than a restatement of Theorem 4.31. 
In detail, let x be an arbitrary element of X, and let (x;,) be a sequence 
in X converging to x. We have, for example, 


jim (f + 9)(&x) = im [f (xe) + 9(xe)] Definition of f +g 
= tim F(t) + tim g(a~) Theorem 4.31 (i) 
= f(x) + g(x) f, g continuous at x 
= (f + 9)(2). 


The remaining assertions are proven entirely similarly. 


Corollary 6.9. Let p and q be polynomials, X = {x in R: q(x) ZO}. 
The rational function f = p/q : X — R is continuous on X. In 
particular, every polynomial function is continuous on R. 


Proof. Intuitively, polynomials are obtained from the identity function 
and constant functions by adding and multiplying, so all polynomials 
are continuous. 

Formally, we prove that polynomials are continuous by induction 
on the degree. Consider the statement P(n): 


Every polynomial function of degree at most n is continuous 
on R. 
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The base case P(0) is true because polynomials of degree 0, i.e., 
constant functions, are (trivially) continuous. Assume inductively that 
for some m > 0 every polynomial of degree at most m is continuous. 


If ag, .--,; Gm; Am41 are arbitrary real numbers, then the polynomial 
function 
pa | 2 m m+1 
f(x) = ao + ayu + Agu" + +++ + Am2t™ + Omyit 
= ao + x(a, + aoe +- +> tage”) + amit”) 


is continuous: The term in parentheses is a polynomial of degree at 
most m, hence continuous by the inductive hypothesis, so f is a sum of 
products of continuous functions, and therefore continuous. We have 
shown that P(m) implies P(m +1) for all m > 0, so by the principle 
of mathematical induction, P(n) is true for all n > 0. 

By Theorem 6.8, a quotient of polynomials is continuous wherever 
the denominator is non-vanishing. 


Proposition 6.10. Let g and f be composable functions, and assume 
that f is continuous at x and g is continuous at y = f(x). Then the 
composition go f is continuous at x. 


Proof. Let (x,) be an arbitrary sequence in the domain of f that con- 
verges to x, and let (yz) = (f(rx)) be the image sequence. Since f is 
continuous at x, the image sequence converges to y = f(x). But since 
g is continuous at y, the sequence (g(yr)) = ((g fo) f)(xx)) converges to 
g(y) = (go f)(x). Since (a,) was arbitrary, go f is continuous at x. 


Conceptualizing Continuous Functions 


In calculus, continuous functions are normally depicted as “smooth” 
graphs with finitely many corners or cusps. “Zooming in” on most 
points causes the graph to “flatten out” into a line. As we will see in 
Chapter 8, this behavior corresponds to differentiability. 

By contrast, a “typical” continuous function has a graph qualita- 
tively similar to the accompanying diagram, more like the tracing of an 
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electrocardiogram, a seismograph, or stock price tracker. 

Imagine the graph as a mountain range. Zooming in reveals cliffs 
and crags, then surfaces of rocks, which are “rough” at scales visible to 
the naked eye and do not appear more smooth when viewed under a 
microscope. 

Mathematically, a “typical” continuous function possesses detail at 
arbitrarily small scales. Since the graph does not become more line-like 
upon zooming in on an arbitrary point, a typical continuous function 
is nowhere differentiable. 

The full ramifications of these qualitative observations impose an 
intuition of continuous functions almost completely different from the 
picture presented in calculus. For instance, the graph of a typical con- 
tinuous function is so rough that its length between an arbitrary pair 
of points is infinite. The only reason we can pretend to draw such a 
function is that a drawing instrument such as chalk, a laser printer, 
or a sharp pencil, does not delimit a mathematical point, but a small 
region. Our drawing instruments “cannot see” details smaller than the 
diameter of the tip, and they manage to “cover” the graph with a region 
of finite area, which can be “painted” in finite time. 

The theorems in this chapter and the next apply to general con- 
tinuous functions. For visual simplicity, proofs are illustrated using 
“smooth” functions. To sharpen your understanding, it’s a good idea 
to ponder how the same arguments succeed against a general continu- 
ous function. 


6.2 Limits 


For theoretical work, it is convenient to have a “challenge-response” 
criterion for continuity that does not explicitly refer to arbitrary se- 
quences. Recall that when X C R, a limit point of X is a real num- 
ber xo (possibly not an element of X) such that BY (xo) NX F @ for 
every 6 > 0. 


Definition 6.11. Let f : X > R be a function, and zp a limit point 
of X. We say the real number L is a limit of f at xo if the following 
condition holds: 


For every ¢ > 0, there exists a 6 > 0 such that if x is an 
element of BS (29) NX, ie., x € X and 0 < |x — a| < 4, 
then |f (a) — L| <. 
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Remark 6.12. Just as with sequential limits, the preceding definition 
may be regarded as an adversarial game between Player ¢, who issues a 
challenge, and Player 6, who attempts to respond, making the distance 
from f(x) to Z smaller than ¢ merely by taking x within a distance 6 
of x. The limit of f at x is L if and only if Player 6 has a winning 
strategy against a perfect opponent (left-hand diagram). 


__ Bs (x0) BS (xo) 
Xv 20) 


As with a sequential limit, a functional limit is unique if it exists. 
Lemma 6.13. Jf L and L’ are limits of f at xo, then L = L’. 


Proof. Let ¢ > 0 be arbitrary. Because L and L’ are limits of f at x9, 
there exists a 6 > 0 such that if « € X and 0 < |x — ao| < 6, then 
| f(x) — L| < e/2 and |f(x) — L’| < ¢/2. By the triangle inequality, 


JL—L'| < |L— f(a)| + |f(v) - L'| < ¢/2+¢/2 =e. 


Since € > 0 was arbitrary, L = L’. 


Remark 6.14. By the lemma, we are justified in treating a functional 
limit as a real number (provided the limit exists), and using notation 
such as 

L=lmG vo) or b= Tn f(x): 


xL—->x0 
If lim(f,29) exists, we may express this fact by saying f(x) ap- 
proaches L as x approaches xq, or by writing “f(a) > Las x > x”. 
Though this “dynamical” language is convenient, it is arguably mis- 
leading. A functional limit at xo either exists or it doesn’t; there is no 
contingency on x approaching the point x9, and we do not have to 
“wait” (possibly forever) to find out whether or not the limit exists. 


Theorem 6.15 (The sequential criterion for continuity). Let f be a 
real-valued function with domain X, and assume ®o € X. The func- 
tion f is continuous at x, if and only if one of the following mutually 
exclusive conditions holds: 


(i) Loo is an isolated point of X. 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


108 CHAPTER 6. CONTINUOUS FUNCTIONS 


(ii) Zoo is a limit point of X, and lim(f, 20) = f (Xoo). 


Proof. ((i) implies continuity). Suppose xz, is an isolated point of X. 
If (z,) is a sequence in X that converges to 2, then (x,;) is eventually 
equal to XQ, i.e., there is an index N such that x, = x, for k > N. 
Continuity of f at x9 follows immediately. 


((ii) implies continuity). Suppose (ii) holds. Let ¢ > 0 be arbitrary. 
By (ii), there exists a 6 > 0 such that if x € X and 0 < |x —2q| < 6, 
then | f(x) — f(Xo0)| < €. Since | f (20) — f(%o0)| = 0 < € automatically, 
f satisfies the slightly stronger predicate: 


If x € X and |x — x| < 6, then |f(x) — f(rxa)| <e. 


Let (x;,) be an arbitrary sequence in X that converges to 74; us- 
ing the 6 of the preceding paragraph as a “challenge”, there exists an 
index N such that if k > N, then |x, — x.| < 6. But as just noted, 
this implies | f(x) — f(®oo)| < €. Since ¢ > 0 was arbitrary, the image 
sequence f (xx)) converges to f(2.); thus f is continuous at 2. 


(Continuity implies (i) or (ii)). Contrapositively, we show that if 
both (i) and (ii) are false, then f is not continuous at Xo. 

Since (i) is false, x is a limit point of X. Since (ii) is false, Player ¢ 
has a winning strategy: There exists an ¢ > 0 such that no matter 
how 6 > 0 is chosen, there is some x in X with |x — x .| < 6 but 
|f(x) — f(to0)| 2 €. 

Construct a sequence (x;) as follows: For each positive integer k, 
pick xz, in X such that |x, — x,.| < 1/k = 6 but |f(az) — f(t0)| > ©. 
The sequence (z;) visibly converges to x, but the image sequence 
( i (x;,)) equally visibly does not converge to f (2). 

We have proven that if (i) and (ii) are false, then f is discontinuous 
at Xoo, Which is the contrapositive of what was to be shown. 


Corollary 6.16 (The ¢-6 criterion). Let f : X + R be a function, and 
assume Xp) © X. Then f is continuous at xo if and only if: 


For every ¢ > 0, there exists a 6 > 0 such that ifx € X and 
|x — xo| < 6, then |f(x) — f(xo)| <e. 


Corollary 6.17. Let f : X > R be continuous at some point x9 in X. 


(i) There exist positive real numbers M and 6 such that |f(x)| <M 
provided x © X and |x — x| < 6. 
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(ii) If f(vo) 40, there is ad > 0 such that ifx € X and |x — xo| < 4, 
then |f(x)| > |f(eo)|/2. 


Remark 6.18. Conclusion (i) is expressed by saying that a continuous 
function is locally bounded. Conclusion (ii) says that if a continuous 
function is non-zero at some point, then the function is locally bounded 
away from zero; not merely is |f(x)| non-zero, there is a positive lower 
bound, | f(ao)|/2. In each case, a property of the function at one point 
“propagates” to some open interval. 


Proof. (i) Take ¢ = 1. Let M = |f(xo)|+1, and use continuity of f at xo 
to pick 6 > O such that if x € X and |x—2| < 6, then |f(x)—f(ao)| < ¢. 
By the triangle inequality, if ¢ € X and |x — x| < 6, then 


IF(@)| < [Flo] + |F@) — Flwo)| < |F(@o)| + 1 = M. 


(i) Take ¢ = |f(ao)|/2, which is positive by hypothesis, and use 
continuity of f at x9 to pick 6 > 0 such that if « € X and |x — xo| < 4, 
then | f(x) — f(xo)| < ¢ = |f(xo)|/2. By the reverse triangle inequality, 
if x € X and |x — x| < 6, then 


[f(x)| 2 |F(ro)| — lf) — Fo) > IF (20) /2. 


Theorem 6.19. Let X be an open interval of real numbers. If f is 
strictly monotone on X, then the inverse function f-!: f(X) > X is 
continuous. 


Proof. Without loss of generality, we may assume f is strictly increas- 
ing. Fix yo in f(X) and ¢ > 0 arbitrarily. There exists a unique 29 
in X such that f (xo) = yo. Since X is an open interval, we may assume 
(by making € smaller if necessary) that [xo — €,2%9 + ¢] C X. 

Since f is increasing, f~! is increasing by Lemma 5.37, and we have 
f(zo -—€) < y < f(xo +¢) if and only if zp —e < fo'(y) < ao +e. 
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Put = min(f(2xo +€)— yo, yo — f(%o — é)). We have 6 > 0, and if 
yo-d <y<yot4, then f(t —€) < y < f(ao +¢) by construction, so 
ro-e< fly) <apte. 

That is, if y € f(X) and |y — yo| < 6, then |f~!(y) — f7(yo)| < €. 
Since ¢ > 0 was arbitrary, f~' is continuous at yo. 


One-Sided Limits 


Definition 6.20. Let X be a non-empty set of real numbers, and 2p a 
real number. We say xo is approachable from above or approachable 
from the right in X if for every 6 > 0, there exists an x in X such that 
Lo << £2 < 249+ 6; that is, ro < x and |x — Xo] < 6. 

We say Xo is approachable from below or approachable from the left 
in X if for every 6 > 0, there exists an x in X such that rg—0 < & < 2p; 
that is, x9 > x and |x — xo| < 6. 


Example 6.21. Let X = (a,b). The left endpoint a is approachable 
from above in X, and the right endpoint b is approachable from below 
in X. The same is true if X is a closed or half-open interval. 


Example 6.22. The point 29 is approachable from both sides of the 
deleted neighborhood B* (x9). 


Remark 6.23. A real number 29 is a limit point of X if and only if x9 is 
approachable from below or is approachable from above in X. 


Definition 6.24. Let f : X — Ra function and z a real number. 

If x is approachable from above in X, we say a real number L is a 
limit from above or a limit from the right of f at x if for every sequence 
(xz) in X such that 2, > x for all k, we have (f(xx)) > L. 

If x is approachable from below in X, we say a real number L is a 
limit from below or a limit from the left of f at x if for every sequence 
(x,) in X such that 2, < x for all k, we have (f(x,)) > L. 

Either type of limit is called a one-sided limit of f at x. 


Proposition 6.25. Let f : X > R be a function and xo a limit point 
of X. 


(i) If xg is approachable from above in X, and if L and L’ are both 
limits of f at x9 from above, then L = L’. 


(ii) If xo is approachable from below in X, and if L and L' are both 
limits of f at x9 from below, then L = L’. 
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(iii) If xo is approachable both from above and from below in X, then 
lim(f, xo) exists and is equal to L if and only if both one-sided limits 
of f at xo exist and are equal to L. 


Remark 6.26. By (i) and (ii), one-sided limits are unique (if they exist). 
We write L = lim(f, 2g) to signify that L is the limit from above of f 
at xo, and write L = lim(f,2 9) to indicate that L is the limit from 
below of f at xo. These limits are alternatively denoted 
lim, f(x) =lim(f,ag), lim f(x) = lim(f,29). 

Proposition 6.27 (¢-6 criterion for one-sided limits). Let f: X > R 
be a function, and assume Xo is approachable from above in X. We 
have L = lim(f,xG) if any only if the following holds: 


For every ¢ > 0, there exists a 6 > 0 such that if x € X and 
Lo <x2< 2+, then |f(x) -—L| <e. 


Remark 6.28. There is an obvious modification for limits from below. 
These properties are established in the same way as the corresponding 
assertions for two-sided limits. 


Theorem 6.29. Let f : X — R be bounded and monotone. For every 
real number Xo: 


(i) If 9 ts approachable from above in X, then lim(f, xj) exists. 


(ii) If xo is approachable from below in X, then lim(f, x9) exists. 


Remark 6.30. The boundedness hypothesis may be dropped, with the 
understanding that the one-sided limits of f at the “extremities” of X 
may be infinite. 


Proof. (i) Assume 29 is approachable from above in X. The set 
A={f(z):cxEX andzt>xw}F4O 


is bounded below by f(xo). It suffices to show lim(f,2¢) = inf A. 

Let ¢ > 0 be arbitrary. Since inf A + € is not a lower bound of A, 
there exists an 2; > Zo in X such that inf A < f(x) < inf A+e, see 
diagram. Put 6 = x; — 29 > 0. 

If xo <4 <a2ot+6 =, then inf A < f(x) < f(a) < inf A+e by 
monotonicity. Rearranging, 0 < f(#) —inf A < «, so |f(x)—inf A] <e. 
Since ¢ > 0 was arbitrary, lim(f, 2) = inf A. 

The proof of (ii) is entirely similar, see Exercise 6.3. 
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inf A+e a 
inf A = lim(f, zg) 


The Calculi of Sloppiness 


Analysis is founded on approximation and estimates. Computational 
notation for approximations will streamline our work. 


Definition 6.31. Let f and g be functions on X, and assume x € X. 
We say g approximates f to within © near x9, and write 


g(x) = f(x) +A(e) for x & ao, 


if there exists a 6 > 0 such that |g(x) — f(x)| < ¢ whenever x € X and 
|x — xo| < 6. 

If g approximates f to within € near x9 for arbitrary ¢ > 0, we write 
g(x) © f(a) + o(1) for x & ao. 


Example 6.32. If f(xo) is defined, then Corollary 6.16 asserts that 
f(x) © f(ao) + o(1) for x © xo if and only if f is continuous at 29. 


Example 6.33. Theorem 6.8 and the preceding example guarantee 
that “approximations” f(a) + f(ao)+o0(1) and g(x) & g(a) + o(1) for 
x & Xo can be added, multiplied, and (if the denominator is non-zero) 
divided in the “obvious” way: 


In particular, o(1) + o(1) © o(1), o(1) -0(1) © o(1), and C- o(1) & o(1) 
for arbitrary real C. 

The notational benefit is clear; the “error term” o(1) acts like a 
sponge, absorbing (and therefore hiding) “ignorable” cross terms. This 
magic works because we may shrink 6 “inside o(1)”, retaining an open 
interval on which the inequality of interest continues to hold. 
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Definition 6.34. Let g be a function that is non-zero on some deleted 
neighborhood of x9. We write 


f(x) ¥ o(g(a)) for a & 29, 
read “f is little-o of g near x”, if f(x)/g(x) = o(1) for x = a9. 


Remark 6.35. Intuitively, f + o(g) for x = x means | f(a)| is infinites- 
imally small compared to |g(x)| when z is sufficiently close to Zo. 


Example 6.36. If k > 0 is an integer, then 


xo(1) forrs0, 


so z**1 = o(x*) for z ~ 0. More generally, if m > 0, then 2*+™ = o(x*) 
for x © 0. 

Similarly, if 2 is an arbitrary real number and if m > 0, then 
(x — x)**™ & o(x — Xo)* for x & Zp. 


Definition 6.37. Let f and g be functions on X. We write 
Fe) POU): tora a5: 


read “f(x) is big-O of 1” near xo, if there exist positive real numbers 
C and 6 such that |f(x)| < C provided x € X and |x — xo| < 6. That 
is, |f| is locally bounded near zo. 
We write 
f(z) © O(g(x)) for x & a0, 


read “f is big-O of g”, if f/g = O(1) for x & 2». 


Example 6.38. If f(x) is defined and f(x) & f(ao) + O(a — 2) 
for x & Xo, then f is continuous at x9: Indeed, there exist positive 
real numbers C' and 6 such that | f(a) — f(xo)| < Cla — xo| provided 
|x — xo| < 0. 

Generally, the following conditions (for 7 * xo) are “increasingly 
strong”, in that each is implied by the next, but not by the previous: 
f(x) © O(1), f(#) & o(1), f(%) % O(@ — 2), f() & ofa — Xo), 
f(x) & O(4 — 20)", f(x)  o(@ — 20)’, .... 

Remark 6.39. The little-o and big-O notations are widespread. By 
contrast, A notation, first advocated in a letter by D. Knuth published 


in the March 1998 Notices of the American Mathematical Society, is 
not in wide usage. 
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6.3 Properties and Applications 


Continuity of Power Series 


Theorem 6.40. Let )>,,a,2" be a power series with radius R > 0, and 
let x9 be a real number. The real-analytic function 
f(x) =) ax(x — 20)" 
k=0 


is continuous on the interval Br(ao) = 0 + (—R, R). 


Remark 6.41. As usual, replacing x — x9 by x reduces the theorem to 
the case 2p = 0. 

Conceptually, the proof proceeds by showing that (i) for each r < R, 
the sum f is approximated arbitrarily closely on [—r,r] by its partial 
sums, and (ii) a function that is approximated arbitrarily closely by 
continuous functions is itself continuous. 


Definition 6.42. Let f and g be functions on X. We say g approxi- 
mates f to within e on X, or g uniformly approximates f to within e, 
and write 

gx f+A(e) onX, 
if |g(x) — f(x)| < e for all x in X. 


Remark 6.43. Geometrically, “g ~ f + A(e) on X” means the graph 
of g over X lies in the “tube” of radius ¢ centered on the graph of f, 
ie., f(z) —e€ < g(x) < f(x) +6 for all x in X. 


frte 
g. 
f-€« 


Two functions f and g are equal on X if and only if g = f + A(e) 
on X for every ¢ > 0. 


Proposition 6.44. Let f(x) = So, axx* be a convergent power series 
with radius R > 0. For each n > 0, define 


n 
fr(x) = S— agx* = ao + 40 + Age +++ + a,x”. 
k=0 
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For every ¢ > 0 and every positive real number r < R, there exists 
an N such that ifn > N, then f & fn +A(e) on [-r,7]. 


Proof. Fix ¢ > 0 and 0 <r < R arbitrarily. 
By Corollary 5.64, 5°, |a,r*| converges, so its tails converge to 0; 
specifically, there exists an N such that if n > N, then 


CO CO 
S- lanr*| = Ss" lanr* | < €. 
k=n4+1 k=N+1 


But for all x in [—r,r], we have 


f(z) = fal@)|= |S) axe” — > axa") =| 5 aye* 
k=0 k=0 k=n+1 
= » ja,x*| < 2 lanr*| < e; 
k=n+1 k=n+1 
that is, f © fn + A(e) on [—-r,r]. O 


Proof of Theorem 6.40. Each partial sum f,, of the series for f is a 
polynomial, hence continuous on (—R, R). 

Fix x in (—R, R) and < > 0 arbitrarily. Set r = $(|z| + R), so that 
|x| <r < R, and use Proposition 6.44 to choose N such that 


f = fw +A(e/3) on [-71,7]. 


Now use continuity of fy to choose a positive number 6 < r — |z| 
such that if |t — z| < 6, then | f(t) — fu(x)| < €/3. 

If |t — z| < 6, then |t| < |z|+ |t-—a2| < jz] +6 <r. That is, 
B(x) C [-r,r]. By the triangle inequality, if |f — z| < 6, then 


If) — f(z) < FQ) — fv ()| + fv) — frv()| + | frv(@) — f(a) | <e. 
<e/3 <e/3 <e/3 


Since ¢ > 0 was arbitrary, f is continuous at x. Since x in (—R, R) was 
arbitrary, f is continuous on the open interval (— R, R). 


Theorem 6.45 (The identity theorem for power series). Let 
f(x) = SJ ag (a — #0)" 
k=0 


be a convergent power series with radius R > 0. If f(a) = 0 for all x 
in Br(xo), then ay = 0 for all k. 
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Remark 6.46. Theorem 6.45 guarantees that if two convergent power 
series centered at 29 agree on some open interval J, they are identical 
(i.e., have the same coefficients). 


Proof. As usual, assume xo = 0. We will establish the contrapositive: 
If some coefficient is non-zero, then f(x) is not identically zero. Let 
n be the smallest index such that a, 4 0. We have 


fig) SG," a,210"" Pager + ew 


= Ont" (1 + (Gn41/dn)t + (An42/Gn)z" +...) = anZ” G(Z). 


The power series g(x) is convergent with radius R. Theorem 6.40 im- 
plies g is continuous at 0, and clearly g(0) = 1. By Corollary 6.17, 
there is an open ball Bs(0) on which g(x) > 1/2. On the deleted ball 
B (0), we have |f(x)| > |an/2| |2|" > 0. 


An analytic function expanded in a power series centered at 0 can 
be easily separated into its even and odd parts (Example 5.16). 


Proposition 6.47. Let R > 0, and assume f(x) = S>,aex* converges 
absolutely for |x| < R. In the interval (—R, R), the even and odd parts 
of f are given by the convergent power series 


[o.e) 
= 2 4 = 2k 
Ve 2 ue, fe. 
feven() = Go + Agu" + a4x So aann”*, 
k=0 
Co 
— 3 5 = 2k+1 
= = , 
foaa(x) = @1 + a3z” + a5x So aap 410 
k=0 


the sums of the even-degree terms and odd-degree terms, respectively. 


Proof. Substituting —x for x, we have 


f(-—#) = S > ae(—a)! = So (-1)’aex* = Ap — a2 + age”? — agx? +.... 
¢=0 e=0 


Adding this to the series for f(x), the odd-degree terms cancel and the 
even-degree terms are doubled. The even part of f is therefore the sum 
of the even-degree terms of the power series. 

Similarly, subtracting the series for f(—«) from the series for f(x), 
the even-degree terms cancel and the odd-degree terms are doubled. 
The odd part of f is therefore the sum of the odd-degree terms of the 
power series. 
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The Intermediate Value Theorem 


Suppose f is a function and y is a real number. As we saw earlier when 
considering surjectivity of the squaring function f(x) = x”, it may be a 
subtle issue to prove that the equation f(x) = y has a real solution z. 

The “Intermediate Value Theorem”, Corollary 6.50 below, gives a 
useful sufficient condition under which an equation f(z) = y is guar- 
anteed to have a real solution. 


Theorem 6.48. Let a < b be real numbers, and let f : |a,b] > R be a 
continuous function such that f(a) <0 < f(b). There exists an xo in 
the open interval (a,b) such that f(a) = 0. 


Proof. Let A = {x in [a,b] : f(x) < 0} be the set of points at which 
f(x) is negative. Since f(a) < 0, we have a € A; consequently, A is a 
non-empty set of real numbers that is bounded above (by 6). Define 
Xo = supA. It suffices to prove x € (a,b) and f(x) = 0. 

By Corollary 6.17, if f(z) < 0, there exists an open interval centered 
at x on which f is negative, and if f(a) > 0, there exists an open interval 
centered at x on which f is positive. In particular, there exists a 6, > 0 
such that f is negative on (a,a+ 61) (soa < a+, < 2%), and there 
exists a 62 > 0 such that f is positive on (b— 59, b) (so rp < b—d2 < b). 
This completes the proof that a < x29 < b. 

By the trichotomy axiom, exactly one of the following alternatives 
holds: f(xo) < 0, f(ao) > 0, or f(xo) = 0. It suffices to prove the first 
two are impossible. 

If f(x) were negative, Corollary 6.17 would imply there exists a 
6 > 0 such that f(x) < 0 for x) < x < % +6; this would mean zo is 
not an upper bound of A. Since x = sup A 7s an upper bound of A, 
f (xo) is not negative. 

If f(ao) were positive, Corollary 6.17 would imply there exists a 
6 > 0 such that f(x) > 0 for 9 — 6 < © < 2; this would mean that 
Xp —0 < Xo is an upper bound of A. Since 2 = sup A is the least upper 
bound of A, f(2o) is not positive. 


Remark 6.49. The same conclusion holds if f(b) < 0 < f(a): Apply 
the theorem to the continuous function g(x) = —f(«), which satisfies 
the condition g(a) < 0 < g(b). 


Corollary 6.50 (The Intermediate Value Theorem). Let a and b be 
real numbers with a < b, and let f : [a,b] + R be a continuous function 
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such that f(a) # f(b). If yo is a real number between f(a) and f(b), 
then there exists an Xo in (a,b) such that f(xo0) = yo. 


Proof. Apply Theorem 6.48 to the continuous function g(x) = f(x)—yo, 
noting that g(z9) = 0 if and only if f(xo) = yo. 


Remark 6.51. The Intermediate Value Theorem guarantees that the 
image of a closed, bounded interval |a, b] under a continuous function f 
is itself an interval. (Theorem 6.57 below implies the image is actually 
a closed, bounded interval.) 


Example 6.52. The rational function f(x) = 1/z, defined for x ¥ 0, 
is continuous throughout its domain. Moreover, f(—1) = —1 < 0 and 
f(1) =1> 0. However, f(a) ¢ 0 for all x. This does not contradict 
the Intermediate Value Theorem because the domain is not an interval. 
(In accord with the Intermediate Value Theorem, the sign of f does not 
change on any interval contained in the domain of f.) 


Existence of Roots 


Theorem 6.53. Let c > 0 be real, and let n > 1 be an integer. There 
exists a unique positive real number xo such that xj = c. 


Remark 6.54. A number x satisfying x” = c is called an nth root of c. 
The unique positive nth root of a positive real number c is customarily 
denoted %/e or cl/”. 

The number \/c = c'/? is called the square root of c. The number 
*/c = cl’? is called the cube root of c. 


Proof. Let f :R — R be the polynomial function f(x) = 7”. We have 
f(0) =0 <c, while by Theorem 2.26, 


faite) =(14+c)">1l+ne>1l+ec>e. 


The Intermediate Value Theorem applied to f on the interval [0, 1+ c] 
guarantees there exists a real number 29 such that 0 < %) < 1+c¢and 
Xo =C. 

There cannot be more than one such number: By Lemma 5.33, f is 
strictly increasing, hence injective. 


Theorem 6.55. Let n be a positive integer. The nth root function 
f : (0,00) > [0, 00), defined by f(x) = «/”, is bijective and continuous. 
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Proof. The nth power function g(x) = x” is easily checked to be the 
inverse of f, so f is bijective. Since f is strictly increasing, f~! is 
continuous on (0,00) by Theorem 6.19. 

To establish continuity at 2) = 0, fix « > 0, take 6 = e”, and note 
that if 0 < x < 6, then 0 < gl” <e, 


Remark 6.56. Let « > 0. We define fractional exponents by 
gim/n = (gl) = (x™)/r 


the unique positive real number whose nth power is x”. It is straight- 
forward to check that the laws of exponents in Theorem 2.25 hold for 
rational exponents. 


The Extreme Value Theorem 


Theorem 6.57. Let a < b be real numbers, and let f : [a,b] > R be 
a continuous function. There exist points min aNd Lmax in [a,b] such 
that 

f tan) ef a) Sees)! forall 2 in-|a, Ol. 


In words, a continuous function achieves a maximum value and a 
minimum value on every closed interval [a, b] in its domain. 


Proof. The strategy is first to show that a continuous function must 
be bounded, then to show the supremum and infimum are actually 
achieved. 


(Continuous implies bounded). Assume contrapositively that f is 
unbounded on [a, b]. We will show there exists a point x at which f is 
discontinuous. 

Since f is unbounded, for every natural number n, there exists a 
point x, in [a,b] such that |f(z,)| > n. Choosing one such point for 
each natural number n gives a sequence (x,) in [a,b]. The Bolzano- 
Weierstrass theorem implies there exists a subsequence (2,,)) that 
converges to some real number x. By construction, a < 2%) < b 
for all k, so % € [a,b] by Proposition 4.35. Finally, 


lf(Z.(e))| 2 u(k) =k for each k > 1, 


which means the image sequence yz, = f(21(%)) is unbounded, and hence 
divergent. Since (2,x)) — Yoo but the image sequence is not conver- 
gent, f is discontinuous at Xo. 
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(Extrema are achieved). Since f is bounded, the image of f has a 
supremum (@ and an infimum a. It remains to prove there exist points 
Cini Bd Vase Sach that: f (emis) =we-and: fF (ax). = 8: 

For each positive integer n, 6 — 4 < 6 is not an upper bound of the 
image, so there exists a point x, such that 3 — 4 < f(t) < 8. Again, 
we have constructed a sequence (x,) in [a,b], and by the Bolzano- 
Weierstrass theorem, there is a subsequence (2K) converging to some 
point Zax in [a,b]. Since 


Bs < flew) <8 for all. A> 1, 


continuity of f implies f(amax) = lim, f(x(4)) = 8. 
Achievement of a@ is proven entirely similarly. 


Example 6.58. The reciprocal function f(a) = 1/z, defined for all 
x # 0, is continuous throughout its domain, but is not bounded above or 
below. This does not contradict the Extreme Value Theorem, because 
the domain of f is not a closed, bounded interval. 


Example 6.59. The polynomial function f(z) = x, defined on the 
interval X = (0,1), is bounded, but does not achieve a minimum or 
maximum value. There is no conflict with the Extreme Value Theorem 
because X is not a closed interval. 


Example 6.60. The signum function (Example 6.3) achieves an ab- 
solute maximum of 1 at every positive real number, and achieves an 
absolute minimum of —1 at every negative real number. However, the 
domain R \ {0} is not a closed, bounded interval. 


Infinite Limits 


The symbols oo and —oo do not denote real numbers, but extended real 
numbers, which may be viewed as “endpoints” of the real number line. 


Definition 6.61. Let X be unbounded above, and f: X > Ra 
function. An extended real number L is a limit of f at oo if for every 
sequence (x;,) in X such that (x;,) + oo, we have (f(x,)) > L. If this 
condition holds, we write f(z) + L as x > oo, or 


hal (00) = lim: J (a): 


Lo 
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Remark 6.62. A limit at infinity is unique (if it exists). Further, there 
is an analogous definition for the limit of f at —oo if the domain of f 
is unbounded below. 


Theorems 4.31 and 4.41 immediately imply corresponding proper- 
ties for functional limits: 


Theorem 6.63. Let X be unbounded above, and let f and g be func- 

tions on X. 
Tf lim(f,0o) and lim(g, 00) are finite, then 

(i) lim(f + g, co) = lim(f, oo) + lim(g, 00). 

(ii) lim(fg, 00) = lim(f, 00) -lim(g, 00), 

(iii) If lim(g, oo) £0, then lim(f/g, co) = lim(f,00)/lim(g, 00). 
Tf lim(f, 00) = 00 and lim(g, co) = L is finite, then 

(iv) lim(f + g, 00) = oo. 

(v) If +L > 0, then lim(fg, co) = too. 

(vi) If f(x) £0 for all x in X, then lim(g/f,co) = 0. 

Similar formulas hold for limits at —oo. 


Example 6.64. If n > 1 is an integer, then 7” — oo as x — ov, and 
x” — (—1)"00 as > —0co. 


Example 6.65. If p is a monic polynomial, i.e., if the degree is at 
least 1 and the leading coefficient is 1, then p(x) > oo as x > oo, and 
p(x) > (—1)"0o as x — —oo. To prove this, write (for x 4 0) 


1 


p(x) = 7" mg ape 
= 2"(1+n1/e +++: +ai/2"' + a9/x"). 


a,x + Ap 


Inside the parentheses, each summand except the first approaches 0 as 
|x| —> oo, so the terms in parentheses approach 1. The assertions follow 
from part (v) of the theorem. 
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Iteration, and Recursive Sequences 


Definition 6.66. Let f : X — X bea function, so that f is composable 
with itself. We recursively define the (forward) iterates of f by 


fla. fe =fofll fork>0. 


That is, fll =f, fMl= fof, fel =fofof, ete. 
The pair (X, f) is called a discrete dynamical system. 


Example 6.67. If f(x) = x? —1, then 


a fl(n))? —1= (a4 — 227)? —1 = 2° — 428 + 4z4 - 1, 
= fP\(axy)? =1= (7° —4z° +4¢* = 1)? = 1, 


and so forth. 


Definition 6.68. Let (X, f) be a discrete dynamical system. For each 
“seed” or “initial value” xo in X, there is a recursive sequence (xx) 
defined by 

Cie (eR). fOr sk SO. 


1 f ! f 1 
Xo vQ M4 v3 Ly 


Proposition 6.69. Let X be non-empty, and let f : X > X bea 
continuous function. If a recursively-defined sequence converges to a 
WOU Ba VA then 7 (Ge) — ax: 
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Proof. Since f is continuous, 


F(®o0) = f (lim ae) = lim f(x) = lim try1 = too. 


Remark 6.70. A point x such that f(x) = 2 is called a fixed point of f. 
The proposition says that if a recursive sequence converges, the limit 
is a fixed point of f. 


Example 6.71 (Newton’s method for square roots). Let c > 1, and 
define the function f : (0,00) + (0,00) by 


ise (x e\ ee 


2 x 25 
Pick a seed x with x2 > c, such as tp = c. For k > 0, algebra gives 
x2 +c) 
ee ee far = 

_ (ay + 2cxz +c?) — 4cxz 

7 (Qi5%)? 

_ a —Qcaz+e? — (ai-—c)? 

(263)? (Qa)? ? 


which is positive by induction since x2 — c > 0. Consequently, 


1 ise 1 c tee. 6 
Lk — Ley = Ce — = | Le =-(z,-— |) =—— > 0. 
b— Te = Te oe k=, in 


We have shown that the recursive sequence (x;,) is positive (hence 
bounded below) and strictly decreasing, so (x) converges to a non- 
negative limit x. By Proposition 6.69, we have 


rote 
eae 


Rearranging, 72, = Cc, 80 24 = Ve since the limit is non-negative. 


The convergence is remarkably rapid. Put 
Cx = U— C= (ty + Ve)(e — Ve) < 2c(x, — Vo), 


essentially a constant times the amount by which 2, differs from /c. 
As shown above, 


2 
5 re —c e .é 
ji =a eS =—5<—. 


That is, the number of decimals of accuracy more than doubles with 
each step of the iteration. 
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Exercises 


Exercise 6.1. Let 


p(x) = A + ax + az? + +++ + anx”, 
g(x) = bo + byx + box? +--+ + dn t™, 


be polynomial functions with a, 4 0 and b,, 4 0, and consider the ra- 
tional function f(x) = p(x)/q(x), defined on its natural domain. Prove: 


(a) Ifn <m, then f(x) — 0 as |x| > on. 
(b) Ifn =m, then f(x) > a,/bm as |x| oo. 
(c) Ifn >™m, then f(x) > sgn(ap/bm) -0o as Z > oo. 
Exercise 6.2. Let p: R > R be a monic polynomial, i.e., 
p(t) = 2" + a,_10" 1 +---+ ax + apo. 
(a) Prove that if n is odd, then p has a real root. 
(b) Prove that if n is even, then p has an absolute minimum. 
Exercise 6.3. Supply a proof of statement (ii) in Theorem 6.29. 


Exercise 6.4. For each real number x, we define the floor |x| to be 
the largest integer n such that n < x. Similarly, the ceiling [x] is the 
smallest integer n such that 7 <n. 


(a) Sketch the graphs: y = |z|, y= [zr], y=a2—-|z], y= [2] — [a]. 


(b) Let f(x) = [a] — [a]. At which points xo does lim(f,29) exist? 
At which points is f continuous? 


Exercise 6.5. Take c = 3 and xp = 2 in Newton’s method. Find the 
next three terms of the sequence as reduced rational numbers. Using 
the fact that 1.7 < /3 < 1.8, find the smallest positive integer k such 
that |r, — V3] < 0.5 x 1077°. 


Exercise 6.6. Take c = 5 and xp = 5/2 in Newton’s method. Find the 
next two terms of the sequence as reduced rational numbers. Using the 
fact that 2.2 < \/5 < 2.3, find the smallest positive integer k such that 
lrg —/5| < 0.5 x 107%. 
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Exercise 6.7. Use Exercise 2.10 to prove n/" = %/n > las n— oo. 


Exercise 6.8. Let p > 0. Prove that p!/" = </p > 1lasn— oo. 
Suggestion: Reduce to the case p > 1, and use the preceding exercise. 


Exercise 6.9. Let xq be Dirichlet’s function, 


(x) 1 if x is rational, 
sbi = 
ie 0 if x is irrational. 


(a) Prove that xq is discontinuous at every real number. 


(b) Let f be a continuous function. Prove that f - yv@ is continuous 
at x if and only if f(x) =0. 


Exercise 6.10. Let f be Thomae’s function, 


1/q if c =p/q in lowest terms, 
f(x) = tone 
0 if x is irrational. 


Prove that lim(f,2) = 0 for all real x. (Thus f is continuous at every 
irrational number and discontinuous at every rational.) 

Hint: If N is a positive integer, then f(x) > 1/N if and only if x € Qy. 
By Exercise 3.14 (b), every point of Qy is isolated. 


Exercise 6.11. Let J be an interval. A function f : J > I is said to 
be a contraction on I if there exists a positive real number jz < 1 such 
that if x, y are elements of J, then | f(x) — f(y)| < pla — y|. 


(a) Prove that a contraction has at most one fixed point. 


(b) Let 2g be an element of J, and let (x;,) be the recursive sequence 
with seed xp. Use induction to prove that |r,4, —arz| < p*|a1 — xo| 
for all k > 0. 


(c) Prove that for all k > 0 and all m > 0, 
k 


Lt 
1—p 


Deen ee Sle 


Conclude that (x;,) is a Cauchy sequence. 


(d) If the interval J is closed (but not necessarily bounded), then a 
contraction on J has a fixed point. 
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Exercise 6.12. Define f : (0,00) > (0,00) by f(x) = a+ (1/z). 


(a) Prove that |f(x) — f(y)| < |x — y| for all positive real numbers 
x and y. Is f a contraction on (0,00)? 


(b) Let (a,) be the recursive sequence defined by f and having seed 
Xo = 1. Is (a,) Cauchy? 


Exercise 6.13. Fix a real number b > 0, and define f(x) = Vb4 x for 
x > 0. 


(a) There is a unique positive fixed point of f; find it (in terms of b). 


(b) For which 6 is f a contraction on (0,00)? 
Suggestion: Multiply and divide by the conjugate expression. 


(c) Let zo > 0 be the seed for the recursive sequence (2;,) generated 
by f. Show that (a;) converges to the fixed point (whether or not 
f is a contraction). 


(d) Evaluate \/1+V1+V1+... and Dee Sap aaa 


Exercise 6.14. Let f(z) =1/(14+ 2) for x > 0. 


(a) If0 <6 <1, then f is a contraction on [6, 00). 


1 


(b) Evaluate the continued fraction 


deste 
1 
dep 


1+ °°. 


Exercise 6.15. Let X be non-empty. A subset O of X is relatively open 
(in X) if there exists an open subset U of R such that O = XNU. For 
example, O = [0, 1) is relatively open in X = [0, 2]. 


(a) Prove that @ and X are relatively open in X. 


(b) Prove that if {O;}ie7 is an arbitrary family of relatively open sub- 
sets of X, then LU, O; is relatively open in X. 


(c) Prove that if {O;}"_, is a finite family of relatively open subsets 
of X, then (); O; is relatively open in X. 
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(d) Suppose f : X — Risa function. Prove that f is continuous on X 
if and only if the following condition holds: 


For every open set V of real numbers, the preimage 
f7\(V) is relatively open in X. 
Exercise 6.16. Define the Heaviside function or unit step function by 


H(a) = 0 ifx<0O, 
STM Ge eS: 


Let (a), be a sequence that injectively enumerates the rational num- 
bers (i.e., assume every rational number appears exactly once as a term 
of the sequence), and define 


flo) =) 


(a) Prove the series f(x) converges absolutely for every real x, and the 
sum is between 0 and 1. 


(b) Show that for every real number z, the one-sided limit lim(f, x~) 
is the sum of 3E taken over natural numbers k such that a, < 2, 
and find a similar description for the right-hand limit lim(f,x*). 


(c) Prove that the function f is strictly increasing, is discontinuous at 
every rational number, and is continuous at every irrational. 


Exercise 6.17. This exercise sketches the construction of the Cantor 
function, a continuous, non-decreasing surjection f : [0,1] — [0,1] that 
is constant on every open interval in the complement of the Cantor set. 


(a) Find a piecewise description of the function S in the left-hand 
diagram below. The graph is horizontal on the middle third, passes 
through the lower-left and upper-right corners, and consists of three 
segments. 


Let a < band c < d be real. Use shifting and scaling to express the 
function T in the right-hand diagram in terms of S. 


(b) Prove that in the right-hand diagram, the maximum vertical dis- 
tance between the diagonal and the graph of T is no larger than 
3(d —c). (The actual maximum separation is 4(d—c), but the 
cruder estimate suffices for our needs.) 
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1+ 
14 
2 
0 } t 1 
0 1 2 1 
3 3 


(c) Recursively construct functions on [0,1] as follows. Let fo(a) = x 
and fi(z) = S(x). To obtain f,+41 from f,, separately consider each 
interval on which f,, is non-constant and “replace f,(a) by T(x)” 
on that interval: 


y = fol(2) 


Use induction to prove that on each interval where f,, is non- 
constant, i.e., on each component of K,, the function changes 
by = 

Use part (b) to conclude that sup |fn(z) — fn4i(x)| < saa. (The 
supremum is taken over all x in (0, 1].) 


Use the triangle inequality and the geometric series formula to prove 
sup |fn(2) — fa+n(2)| < gz for all k > 0. 


(d) By part (c), for each x in [0,1], the sequence (f;,(x)) is Cauchy. 
Let f(x) be the limit. Prove that f is non-decreasing, takes values 
in [0, 1], is constant on each interval in the complement of the Cantor 
set, and is continuous. 
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Integration 


7.1 Partitions and Sums 


Definition 7.1. Let a < b be real numbers. A partition of the closed 
interval J = [a, }] is a finite collection of points P = {t;}"_) such that 


GH1g ty Ste Se ee < = O, 


The interval J; = [t;-1, ti] is called the ith subinterval of the partition. 
Its length is 


At; — t; a tj_1- 
Ati | Nts | At3 | _ Atn 
a= to hj ty a 1) i t3 tn—1 I, tn =b 


Definition 7.2. Let P and Q be partitions of J. We say Q is a refine- 
ment of Pif PCQ. 


Remark 7.3. A refinement of P is obtained by adding finitely many 
points to P. If P and P’ are partitions of J, their union Q = PU P’ is 
a “common refinement”, i.e., a refinement of each. 


Example 7.4. Let n > 1 be an integer. An equal-length partition has 
n subintervals, each of length At = (b — a)/n: 


P, = {a,a+ At,a+ 2At,...,a+nAt = d}. 


In this example, P,, is a refinement of P, if and only if n divides n’. 


129 
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Definition 7.5. Let f : [a,b] > R be a bounded function. For each 
partition P of J = |a,b| into n subintervals, and for each index i with 
1<i<n, put 


m, = inf{f(t):t € i}, M; = sup{ f(t): ¢t € &}. 


We define the lower sum and upper sum of f with respect to P by 
L(f,P)=S om Ati,  U(f,P) => Mi At. 
i=l i=1 


Remark 7.6. Geometrically, the summand ; At; is the signed area of 
the lowest rectangle that lies entirely above the graph of f on J;, and 
the summand m; At; is the signed area of the highest rectangle that 
lies entirely below the graph of f on J;. 


L(f, P) 


Lemma 7.7. Let f : [a,b] > R be a bounded function. If P and Q are 
partitions of |a,b| and Q is a refinement of P, i.e., P CQ, then 


L(f,P) < L(f,Q) < UF,Q) < UF, P). 


Proof. Since every refinement of P is obtained by appending finitely 
many points to P, induction on the number of points in Q \ P reduces 
the claim to the case where Q = PU {z} for some z. 
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M; M! Mj 
j 
mis 
m5 mi 
3 t; tj_-4 z t; 
At; ! t At, 4+— Ati —4 
Assume z € I; for definiteness, and write J; = |t;-1, 2] U [z,t)]. 


Let mi, and m/ denote the respective infima of f on the subintervals 
I, = [tj-1, 2] and I = |z,t,]. Since each subinterval is contained in J;, 
we have m; < mj, and m; < m‘. Consequently, 


my At; = mj; (At, + At}) < mi; At; + mj Ath. 


Since the lower sums L(f, P) and L(f,Q) have identical summands if 


i # Jj, we have L(f, P) < L(f,Q). 
A completely analogous argument shows U(f,Q) < U(f, P). 


Proposition 7.8. Let f : [a,b] > R be a bounded function. If P and 
P’ are arbitrary partitions of |a,b|, then L(f, P) < U(f, P’). 


Proof. The partition Q = PU P’ is a refinement of both P and P’. By 
Lemma 7.7, L(f,P) < L(f,Q) <U(f,Q) <U(f,P). 


Remark 7.9. Let 2 = {L(f, P) : P a partition of |a,b]} be the set of 
all lower sums of f, and let Y = {U(f, P) : P a partition of [a, b]} be 
the set of all upper sums of f. Proposition 7.8 guarantees that every 
lower sum of f is bounded above by every upper sum. In particular, 
the set Y is non-empty and bounded above, and WY is non-empty and 
bounded below. 


Definition 7.10. Let f : [a,b] — R be bounded. The lower integral 
of f on [a,b] is the real number L/(f,[a,b]) = sup, and the upper 
integral of f on [a,b] is the real number U(f, [a, 6]) = inf Y. 

If L(f, a, b]) = U(f, [a, b]), we say f is integrable on [a,b], and call 


L(f, {a,b]) = UC, fa, 8)) = / fe / f(t) at 


the integral of f over [a, )]. 
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Proposition 7.11. A bounded function f : [a,b] > R is integrable 
on |a,b] if and only if the following condition holds: 


For every € > 0, there exists a partition P of [a,b] such that 


Proof. Suppose f is integrable, and let ¢ > 0 be arbitrary. By definition 
of supremum and infimum there exist partitions P’ and P” such that 


Uy, P") - ( | , f) <¢/2, ( ‘i , t) ~ Lf, P’) <e/2. 


If P = P'UP", then L(f, P’) < L(f, P) < U(f, P) < U(f, P”), so 
Cl Ppa Ly2) SUF Ba BFP) <E. 


Inversely, suppose f is not integrable. If we set « = inf Y — sup Y, 
then U(f, P) — L(f, P) > «> 0 for every partition P. 


Example 7.12. Let f be a constant function, say f(t) = c for all t. 
For every partition of [a,b] and for every subinterval of the partition, 
m; = c = M;. Consequently, every lower sum and every upper sum is 


equal to c(b — a), so 
b b 
Li) cdt = c(b—a). 


Example 7.13. Let a < % < b be real numbers, and let f = X42}, Le., 
f(t) =1ift =o and f(t) =0 otherwise. We will show the function f 
is integrable on [a,b], and the integral is equal to 0. 

Fix ¢ > 0. We seek a partition P of the form 


to = a, ty = % — 0, to = %p + 6, tz =) 
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for which U(f, P) — L(f, P) < e. It suffices to arrange that a < x — 0, 
Xp +6 <b, and 26 < e: Under these conditions, we have 


1 0 O (#-65)-a 0, 6 Le 
2 0 1 26 20, 

— I t | 1 
3 0 O b-—(a+4+6) 0, a t, 20 ty b 


so that U(f, P) — L(f, P) = 26 < e. Since € > 0 was arbitrary, f is 
integrable on [a,b]. Since every lower sum is 0, the integral of f is 0. 

Obvious modifications of this argument handle the possibility that 
t=O or. 25 =. 


Example 7.14. Let f = xq be the characteristic function of Q. Then 
f is not integrable on [a,b], no matter how a < b are chosen. Indeed, 
let P be a partition of [a, b]. In each subinterval, there exist both ratio- 
nal numbers and irrational numbers (see Theorem 3.81 and subsequent 
remarks), so f takes on the values 0 and 1 in every subinterval, i.e., 
m, = 0 and M; = 1 for every 7. Thus, 


LG P\= S70AL, =0, U(f,P)= ST 1A = (b—a), 
i=1 i=l 


regardless of P. This means 0 = L(f,[a,b]) < U(f,[a,6]) = b — a, so 
f is not integrable on [a, }]. 


Example 7.15. Assume 0 < a < b, and let k be a positive integer. 
Consider the monomial function f(t) = ¢* on [a,b]. We will prove from 
the definition that f is integrable on [a, b], and 


b k+1 k+1 
b ce 
/ t* dt = -—___* 
: k+l 


It is convenient to use a “geometric” partition, for which the ratio 
of the lengths of consecutive intervals is constant, see diagram below. 

Let n > 0 be the number of subintervals, and put p = ~/b/a > 1, 
so that b = ap". The partition is P = {t;}"_9, with t; = ap’, so we have 
At; = ap' — ap’ + = a(p —1)p'! for i=1,...,n. Since f is increasing 
on [a,b], mi = f(ti-1) = (ap’')* and M; = f(t;) = (ap')*. Because 
M, = p*m, for each i, the upper sum is p* times the lower sum. 
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o- 
oa ¢ 


The general term of the lower sum is 


f (tia) Ati = (ap**)* a(p — Dp? = a®**(p — 1) - (0 *)?. 
n n-l 
The geometric sum formula pts p= ives 
; Oe eae 


L(f,P) = > Fltia) At; = a*(p— 1) (ph) 
i=1 i=1 
k+1\n 1 
= ak p= 1) — ; 
n\k+1 1 
= alti — 1). OP 


To simplify, recall that p"” = b/a, so 
ol pee = 1) = art (Gar _ 1) = pet _ qaktt. 
Note further that 


pret 1 
p-l1 


i=0 


Call this sum S(p) for brevity. By Exercise 6.8, the ratio p = (b/a)/” 
approaches | as n — oo. Consequently, the polynomial S(p) approaches 
lim(S,1) =k +1, and thus 

_ gktl 


as peti _ qk+l peti 
k-+1 —— 
peti — 1 S(p) k+1 


L(f, P) = (Gre az an) 
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Since L(f,P) < sup2% = L(f,|a,b|) for every P, ie., the lower 
integral is no smaller than any particular lower sum, 


pet k4+1 pk+l — gkt1 


—a : 


As noted earlier, U(f, P) = p*- L(f, P), so 


_ ght 


k+1 — 


pet 
U(f,[a,6]) < lim U(f,P) = lim p*- L(f,P) = 


The lower and upper integrals therefore have the same value; this si- 
multaneously proves that f is integrable on [a,b], and evaluates the 
integral. 


7.2 Properties of the Integral 


The result of Example 7.15 is fundamental, but the intricacy of the pro- 
cess should convince you that calculation of integrals from the definition 
should be avoided when possible. In order to calculate integrals from 
more theoretical considerations, we establish several general properties, 
collected here for convenience: 


Theorem 7.16. Leta < b be real numbers, and f, g functions on [a, }]. 


(i) (Linearity) If f and g are integrable on [a,b], and if k is a real 
number, then the functions f +g and kf are integrable on {a,b}, 


and 
foro=fs+ fo fon-ef's 


(ii) (Monotonicity) If f and g are integrable on a,b], and if f(t) < g(t) 


for allt in [a,b], then 
b b 
i ie / g- 


(iii) (Triangle inequality) If f is integrable on |a, b], then |f| is integrable 


on [a,b], and 
fails fu 
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(iv) (Patching property) If c is a real number witha <c <b, then f is 
integrable on |a,b| if and only if f is integrable on the two intervals 
[a,c] and |c, b], and in this event 


fr fae fs 


Remark 7.17. Theorem 7.16 grants computational license to integrate 
sums and differences “term by term”, and to factor constants out of an 
integral; to integrate a (non-strict) inequality, preserving the inequality; 
to move an absolute value inside an integral at the expense of making 
the expression larger; and to break an interval of integration into two 
(or finitely many) pieces, and to add up the resulting sub-integrals. 


Proof. (Linearity). Let P = {t;}"9 be an arbitrary partition of [a, }J. 
For each i = 1,...,n, let I; = [t;_1,¢;], and set mi = inf{ f(t) :t € &}, 
m$ = inf{g(t): t € I,}, m/*9 = inf{(f + g)(t) :t € I}. Since 


{f() + 9) te Li} C (f(s) + 9) + 8,t € Li} 
(a more restrictive predicate defines a smaller set), we have 
mi! + m9 = inf{f(s):s € 1} + inf{g(t) : t € I} 
= inf{ f(s) + g(t): s,t € I} 
< inf { f(t) + 9(t):t€ i} = mits. 


(Loosely, we expect equality when the infima of f and g are achieved 
at the same point of J;.) With analogous notation for the suprema, 
Mit9 < M/ + M9. Adding up these inequalities, 


L(f,P)+L(g,P) < L(f+g9,P)<Uf+g,P) < Uf, P)+UG, P) 


for every partition P. Taking suprema over P for the lower sums and 
infima over P for the upper sums, 


[r+ fasceton soutotons fst fio 


This shows simultaneously that f + g is integrable on [a,b], and that 
the integral has the stated value. 

Integrability of f — g = f + (—1)g will follow once we prove kg is 
integrable for each real number k. To establish the latter claim, we 
consider two cases: k > 0, and k = —1. 
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Let k be areal number. With notation as above, if P is an arbitrary 
partition of [a,b] and i =1,...,n is an index, then 


{(kf)(t) :te L}=k{f(t): te i}; 


that is, the set of values of kf on I; is k multiplied by the set of values 
of f (see Definition 3.24). If k > 0, we have 


mf — inf{(kf)(t):t € 1} =kinf{f(t):te 1} = kml, 
MF = sup{(kf)(t) :t € i} =ksup{f(t):t e} =kM/ 
by Proposition 3.49 and Exercise 3.8. Forming lower and upper sums, 
LEP) =) me At Hk Som, At, = KF P); 
i=1 i=1 


Ob Pa > Mi AGah Sy Mi hi = kOe). 


i=1 i=l 
Since f is integrable on |a, bd}, 
L(kf, [a,6]) = sup L(kf, P) = supkL(f, P) 
P P 
=Ksupi P= kinf U(f, P) 
P 


= inf KU(f, P) = inf U(Kf, P) = U(kE, a. 8), 
proving that kf is integrable on |a,b], and the value of the integral is 
k; times the integral of f. 

If instead k = —1, then 


my! = inf{(—f)(t):t e€ Lj} =—sup{f(t):¢ ¢ i} =—M!, 


7 


Mf = sup{(—f)(£) : ¢ € } = —inf{ f(t): t eG} = —mi. 


Forming lower and upper sums gives 
L(-f,P) =) m;/ Ot; =— >> Mf At; = -U(f, P), 
i=1 i=1 


U(-f,P) = >_> M74 At; =— So mf At; =-L(f, P). 
i=1 i=1 
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Taking the supremum of the lower sums and the infimum of the upper 
sums, 


TAS, [a, b)) = Sus; la, b)) = TG, [a, b}) = Ulf, [a, b)), 
proving that —f is integrable on [a,b], and the integral of —f is minus 
the integral of f. 

(Monotonicity). Left to you, see Exercise 7.1. 


(Triangle inequality). Let f be integrable on [a,b]. Fix « > 0 and 
choose a partition P of [a,b] such that U(f, P) — L(f, P) <. 
By the reverse triangle inequality, 


IF(@)| — FM) < lF(@) — F(y)| for all x, y in [a, b]. 


In particular, letting J; be the ith subinterval of P and taking the 
supremum over x in J;, then taking the infimum over y in J;, we have 


My! — mj! < |Mf - m{| = Mj — mj 


Multiplying by At; and summing over i, 
U(|f|,P) — Lf), P) < Ug, P) - Lf, P) <e. 


Since ¢ > 0 was arbitrary, |f| is integrable on [a, 6]. 
Now, —|f(t)| < f(t) < |f(®)] for all t in [a,b]. Monotonicity gives 


-fuisfirs fin or fasfur 


(Patching property). Let a < c < b be real numbers, f : [a,b] ~ R 
a function, and fix e > 0 arbitrarily. 

Suppose f is integrable on [a,b]. Choose a partition P of [a,b] such 
that 


do (ME — mf) At; = U(f, P) — Lf, P) <e. 

i=l 
Replacing P with P U {c}, we may assume c € P while preserving the 
preceding inequality. 

The set P’ = [a, c]|M P is a partition of [a, c]. Since every subinterval 

of P’ is a subinterval of P, and every summand in U(f, P) — L(f, P) 
is non-negative, U(f, P’) — L(f, P’) < ¢. By Proposition 7.11, f is 
integrable on |a,c]. A similar argument shows f is integrable on [c, }J. 
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Conversely, suppose f is integrable on [a,c] and on |c, b]. Choose 
partitions P’ and P” for [a,c] and [c, 6] such that 


U(f, P’) — L(f, P’) < €/2, U(f, P") — L(f, P") < €/2. 
The union P = P’U P” is a partition of [a,b] for which 
UL Pye) = (U(f, P’)-—L(f, P’)) + (Uf, P”) - L(f, P”)) <€. 


Since ¢ > 0 was arbitrary, f is integrable on [a, }]. 
In either case, L(f, P) = L(f, P’) + L(f, P”), which proves 


fr-fr+ ft 


This completes the proof of Theorem 7.16. 


Corollary 7.18. Let f and g be functions on some interval |a,b], and 
assume f(t) = g(t) except at finitely many points. If f is integrable 
on |a,b], then g is integrable on |a,b|, and the integral of g is equal to 
the integral of f. 


Proof. Consider the function h = g—f, which by hypothesis is non-zero 
at only finitely many points. That is, there exist points 71, 22,...,%m 
in [a,b] and real numbers ky, ko,..., km such that 


h= So ky X10} 
j=l 


By Example 7.13, each function x,~,} is integrable and has integral 
equal to 0. By linearity of the integral, h itself is integrable, and 


b m b 
[=e f xen =0 
a j=l a 


But g = f +h, so linearity implies g is integrable, and 


fo=furm= [r+ fra ft 


Corollary 7.19. Jf f : [a,b] — R is integrable, and ifm < f(t) < M 
for all but finitely many t in [a,b], then 


m(b—a) < [ f <M(b-0). 
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Proof. This follows immediately from monotonicity and the preceding 
corollary. 


The patching property can be expressed in a symmetric form by 
making two conventions. 


Definition 7.20. If f : [a,b] + R is integrable, we define 


[tH [r=-f 


When working with domains of integration, we continue to use “closed 
interval” notation, and write “[b,a]” even if a < 6, interpreting the 
integral from 6} to a as indicated. 


Corollary 7.21 (The cocycle property). Let I be an interval of real 
numbers, and let f : I + R be integrable. For alla, b, c in I, 


[re fs+ forme 


Proof. First assume a < c < 6b. By the patching property and our 
conventions on swapping limits of integration, 


[re fire fr--(frs f), 


so the cocycle property holds in this case. But the stated equality is 
invariant under permutation of the symbols a, b, and c, and is therefore 
true regardless of the ordering of the numbers a, b, and c. 


A Transformation Theorem 


Theorem 7.22. Let I = [a,b] be a domain of integration, and assume 
f is integrable on I. 
(i) For every real number c, 


b+c 


f(t-odt= i f(t) dt. 


a+c 
(ii) If uA 0 is real, then 
b/u 


uf f(ut)dt = f(t) dt. 


a/p 
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Proof. (i) Define 7 : I+c¢ > I by r(t) = t—c. For each partition 
P = {t}, of [a+c,b+ cl], there is a unique partition P’ = {ti}", 
of [a,b] defined by t) = r(t;) =t; —c. 

Since f o7 achieves precisely the same values in J; that f achieves 
in I; we have 


mf = mi", Mi = Ms°. 


Further, At; = (¢; — c) — (&_-1 — c) = At,;. Consequently, 


LG Pye mA = Sm = Ef oP), 
i=1 i=1 
and similarly U(f, P’) = U(fo7,P). The theorem follows at once by 
taking the supremum of the lower sums and the infimum of the upper 
sums. 
(ii) Define 7 : I/p = [a/p,b/p] > I by 7(t) = wt. The preceding 
proof goes through with straightforward modifications, notably that 


Corollary 7.23. Leta >0, and assume f is integrable on |—a, a]. 


(i) If f is even, i.e., if f(—t) = f(t) for allt, then 


[ soa=2f rea 


(ii) If f is odd, i.e., if f(—t) = —f(t) for allt, then 


” F(t) dt = 0. 


—a 


Proof. By part (ii) of the preceding theorem, with py = —1, 
0 0 a 
f(at=— f f(-tjar= | f (—t) dt. 
Breaking up the integral at 0, 
a 0 a 
feda= f(t) a+ | f(t) dt 
iz ay 0 
= fd a — dt. 
[sco f roa= [cot soya 


a 
0 


Both parts follow immediately. 
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7.3 Criteria for Integrability 


Proposition 7.24. Jf f : [a,b] > R is non-decreasing, then f is inte- 
grable on {a, b]. 


Proof. Since f is non-decreasing, f(a) < f(t) < f(b) for all t in [a, 5. 
In particular, f is bounded. 

Fix ¢ > 0 arbitrarily, and use the Archimedean property to choose 
a positive integer n such that (f(b) — f(a))(b—a)/n < e. Let P, be 
the equal-length partition with n subintervals. On the zth subinterval 
I; = [ti-1, ti], we have m; = f(ti_i), Mi = f(t:), and At; = (b-—a)/n 
independently of 7. Writing At instead of At, 


U (fs Pa) — E(F,Pa) = (Wh =m) At, = [SO (FU6) = 16-2) ] 6 


i=1 i=1 
The sum in square brackets telescopes, so 


b-a 
n 


<E. 


U(f, Pu) — LF, Pa) = (f(tn) — f(to)) At = (F(8) — f(a) 


Since ¢ > 0 was arbitrary, f is integrable on |a, )]. 


Integrability of Continuous Functions 


In this section, we prove that a continuous function f : [a,b] — R is 
integrable on |a,b]. The strategy is to show the upper and lower sums 
can be made arbitrarily close with a suitable choice of partition, so 
that f is integrable by Proposition 7.11. We first establish a technical 


property: 


Lemma 7.25. [f f : [a,b] — R is a continuous function, then f satis- 
fies the following condition: 


For every ¢ > 0, there exists a 6 > 0 such that if t and 
t’ € [a,b] and |t —t’| < 6, then |f(t) — f(t)| <«. 


Remark 7.26. Careful comparison of this condition with the ¢-d crite- 
rion for continuity (Corollary 6.16) reveals an important subtlety: Ifthe 
domain of the continuous function f is a closed, bounded interval [a, 6], 
then for every € > 0, there is a single 6 that simultaneously “wins” the 
e-0 game for Player 6 at each point of [a,b]. A function satisfying this 
condition is said to be uniformly continuous on |a, b}. 
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Proof. We proceed contrapositively. If the stated condition fails, then 
Player €¢ can force a win; that is, there exists an ¢ > 0 such that for 
every 6 > 0, there are points t and ?¢’ in [a,b] such that |t — t’| < 6 but 
|f(t)—f(t’)| > ¢. We will prove that in this situation, f is discontinuous 
at some point of [a, 0]. 

Fix ¢ > 0 as in the preceding paragraph. For each positive in- 
teger n, choose points t, and t), in [a,b] such that |t, —t),| < 1/n, 
but |f(tn) — f(#,)| = €. Since [a,b] is a closed, bounded interval, the 
Bolzano-Weierstrass theorem implies there exists a convergent subse- 
quence (t,(%)) > too € [a, 6]. Since 


[Ege — tool S Itacsy — tecayl + [tye — too] S 1/k + [trey — tool; 


the sequence (Chay) also converges to t,.. But by construction, the 
images sequences (f(t,«))) and (f (thay) do not have the same limit 
(even if both limits exist), because | f(t,(«)) — f(tiq))| 2 € for all k. By 
definition, f is discontinuous at ty. 


Theorem 7.27. Let f : [a,b] — R be a continuous function. Then 
f is integrable on |a, b]. 


Proof. Fix ¢ > 0. By Lemma 7.25, there exists a 6 > 0 such that if 
t and t’ are elements of [a,b] such that |t — t’| < 0, then 


F(t) — F(E)| < €/(6- a). 


Use the Archimedean property to pick a positive integer n with 1/n < 46, 
and let P = P,, be the equal-length partition of [a, b] into n subintervals. 
For each i = 1,...,n, if t and t’ € J;, then |t — t’| < 1/n < 6, so 
| f(t) — f(t’)| < e/(b—a). Since f is continuous, f achieves a maximum 
value and a minimum value in J; by the Extreme Value Theorem; thus 
Mi — mi <e/(b—a). 
Summing over 7, 


n 


eS n 
U(f, P) — L(f, P) = "(Mj — mf) At; < ae =6. 


i=1 


Since ¢ > 0 was arbitrary, f is integrable by Proposition 7.11. 


Theorem 7.28. If f and g are integrable functions on |a, b], then the 
product fg is integrable on {a, }}. 
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Remark 7.29. There is no general formula for the integral of fg in terms 
of the integrals of f and g. 


Proof. By the “polarization identity” 
fg=((f+9)-f -9°), 


it suffices to prove that if f is integrable, then f? is integrable. 

Fix ¢ > 0. Since f is integrable, there exists a positive real num- 
ber C such that |f(t)| < C for all ¢ in [a, 6], and there exists a parti- 
tion P of [a,b] such that 


U(f, P) — Lf, P) < e/(2C). 


Suppose t and t’ are elements of some subinterval J;. By the difference 
of squares identity, 


FCC)? — FEY] = FO) + FEN NFO — FO) < 2C - FO) — FO). 
Taking the supremum over ¢, then the infimum over 1’, 


MP —mf <2C-(Mf —m!) TOF t=) toe Mh 


7 


Summing over 7, 


U(f?, P) — L(f?, P) < 2C - (U(f, P) — L(f, P)) <E. 


Since € > 0 was arbitrary, f? is integrable on [a, 0]. 


7.4 Definite Integrals 


Definition 7.30. Let f : [a,b] + R be integrable. For each x in |a, )], 
the function f is integrable on [a,z]. The function F : [a,b] > R 


defined by 4 2 
Fay=f r= f sae 


is called the definite integral of f from a. 


Example 7.31. Let sgn: R > R be the signum function, defined by 
sen(t) = t/|t| if t 4 0, and sgn(0) = 0. We claim the signum function 
is integrable on every closed, bounded interval, and 


i: sen(t) dt = |x| for all real x. 
0 
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To prove sgn is integrable, note that if x > 0, then on the interval [0, z}, 
we have sgn(t) = 1 except at one point. Since a constant function is 
integrable and sgn differs from a constant function at only one point, 
sgn is integrable on [0,2] by Corollary 7.18, and 


[ sentat= | ldt=¢—0=2@ foralla > 0. 
0 0 


An entirely similar argument handles the interval |x, 0] if « < 0, and 
we have 


i. sen(t) dt = i; (—1) dt = -1(a —0) = —x=|a| for all x < 0. 

0 0 

The patching property guarantees sgn is integrable on an arbitrary 
closed, bounded interval. 


Example 7.32. If f is integrable on some interval containing a, 2, 
and y, and F is the definite integral of f, the cocycle property gives 


ry)-Fe)= fr-for= ft 


Theorem 7.33. Let f be integrable on [a,b], and let 


Fa)= ff 


be the definite integral of f froma. 
(i) If |f(t)| <M for all but finitely many t, then 
|F(y) — F(z)| < Mly—2| for all x, y in {a, }]. 
In particular, F is continuous. 
(ii) If f is non-negative, then F' is non-decreasing. 


(iii) If f is continuous and positive except perhaps at finitely many 
points, then F is strictly increasing on |a, }J. 


Proof. (i) We may as well assume |f(t)| < M for all t, since by Corol- 


lary 7.18 we may change the value of f at finitely many points without 
changing the integral. Ifa <«<y <b, then 


[als fuss [= m—a 


|F(y) — F(a)| = 
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To prove F' is continuous, fix ¢ > 0 arbitrarily, and let 6 = ¢/(M + 1). 
(Adding 1 accommodates the possibility that M@ = 0.) If |y —2| < 6, 
then |F(y) — F(az)| < Mly—2|< Mé <e. 

(ii) Suppose f is non-negative. Ifa <a <y <b, then 


o= foas [" s)at= Fl) - Fe) ie., F(x) < F(y). 


(iii) Let a << a < y < b. Since f is continuous and positive except 
perhaps at finitely many points, there exists a point to with 7 < ty < y 
such that 0 < f(to). By Corollary 6.17 (ii), there exists a 6 > 0 such 
that if |t — to| < 6, then f(t) > f(to)/2. Shrinking 6 if necessary, we 
may assume |ty — 6, to + 6] C (x,y). By monotonicity, 


to+6 to+d 


0 < (26)(f(to)/2) = ( 


to—d 


f (to) /2dt < / 


to—d 


f()dt< ie f(t) dt, 


or 0 < F(y) — F(a). That is, F is strictly increasing. 


Remark 7.34. The preceding proof only uses the fact that there exists 
no interval on which f is identically equal to 0. 


Corollary 7.35. [fk > 0 is an integer and x, y are real numbers, then 


ie dee ia 
. k+1 — 


Proof. If x < y are positive, this restates Example 7.15. 
Since each side is continuous in x, taking limits as x — 0 gives 


Us yb 
= for all y > 0. 
[ea al or all y > 


If w < 0, so 0 < —w, then taking 4 = —1 in Theorem 7.22 gives 


ie k k+1 rg we 
t*dt=—- —t)* dt = (-1 t® dt = ——. 
/ i (—t) dt = (-1) / = 


We have established that F(w), the integral of t* from 0 to w, is equal 
to w**1/(k +1) for all real w. If 2, y are arbitrary, then 


k+1 k+1 


y —2 
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Example 7.36. Let 


p(t) = co +t cyt 4 est Kanes ee = yt 
k=0 


be a polynomial. Since p is continuous on R, p is integrable on every 
interval [0,2], and 


r ag n n r n ght 
t)dt = t* dt = | t* dt = —— 


If we call this new polynomial P(x), then 


[mo dt = [mo a fol dt = P(b) — P(a). 


Remark 7.37. To evaluate a definite integral from the definition for even 
a single x, we must compute the supremum of the set of lower sums 
of f as P ranges over the set of partitions of [a,x]. In general this is 
somewhere between laborious and genuinely difficult. 

The preceding example shows that for a polynomial function, the 
definite integral (laborious to evaluate) is equal to a particular polyno- 
mial (trivial to evaluate). That these functions are one and the same 
is a substantial and non-trivial piece of information. 


The Natural Logarithm 


One of the most important functions in analysis may be defined as a 
definite integral: 


Definition 7.38. The natural logarithm function log : (0,co) > R is 
defined for x > 0 by 
"dt 


logz = 
1 t 


Theorem 7.39. For all positive real numbers x and y, 
log ry = logx + logy, log(1/x) = —logz. 


The natural logarithm is strictly increasing and surjective, and there 
exists a unique real number e, with 2 <e < 3, such that loge = 1. 
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Proof. If x and y are arbitrary positive real numbers, then 


“edt Pd. sees 
log ry = i) —= — +f — Patching 
it it « t 


x y 

= dt zi of a Theorem 7.22 with uw = x 
1 t , at 

= log x + log y. 


Taking y = 1/z, we have logx + log(1/xz) = log1 = 0, which proves 
log(1/x) = — log =. 

The logarithm is strictly increasing because the integrand f(t) = 1/t 
is continuous and positive. In particular, there is at most one positive 
real x such that logx = 1. 

To prove there exists a real number e, with 2 < e < 3, such that 
loge = 1, it suffices by the Intermediate Value Theorem to show 


saa ool 
log? = | rat<i< f Fdt=log3. 
if ia 


The first inequality is straightforward: 1/t < 1 on the interval [1, 2], 
with equality only at the left endpoint, so 


24 2 
log? = | vat< f ldt=2-1=1. 
1 t 1 


The second inequality is a bit sneakier: Since 


(¢-2)? ?-—4t+4 


O< Ei a = (t/4) -1+1/t 

for all t > 0, and equality holds only at t = 2, 

a 32 _ 1? 
o< f ((t/4) —1+ (1/t)) dt = = —(3—1) +loz3 = —1+ log3, 

1 
or 1 < log3. 

A straightforward inductive argument shows that for every non- 

negative integer n, loge” = n, and since log(1/x) = —logz, we have 
log e~” = — loge” = —n as well. 


If k is an arbitrary real number, the Archimedean property guaran- 
tees that there exists a positive integer n with |k| <n. Since 


log(e™) = —n < —|k| Sk < |k] <n = loge”), 


the Intermediate Value Theorem applied to log on the interval [e~”, e”] 
shows there exists a real x with log x = k; that is, log is surjective. 
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Integration and O Notation 


Theorem 7.40. Assume f is integrable on some interval containing xo, 
and let 


F(a) =f float 


be the definite integral of f from x9. If there is a positive integer k such 
that f(t) ~ O(t—2xo)* fort & x, then F(x) ~ O(x—29)**1 for x & Xp. 


Proof. By hypothesis, there exist positive real numbers C’ and 6 such 
that |f(t)| < Clt — xo|* for |f — xo| < 6. For rp < x < 49 + 6, 


F@ls f lacse [ @-x)tar- 


If instead rp — 6 < & < XQ, 


xO xO 
F@ls | Olas [ (1) — 1) dt =~ la — 20 aa 


Thus F(x) » O(@ — x9)**" for x = zo. 


7.5 Integration of Power Series 


Theorem 7.41. Suppose we have a power series with radius R > 0: 
f(z) = >| a4(a — 20)* 
k=0 
= a9 +:a1(@ — 29) + ax(e— a9)? +... 


For every x with |x — x0| < R, f is integrable between xo and x, and 


Proof. As usual, assume x) = 0. Theorem 6.40 implies f is contin- 
uous on (—R, R), and therefore integrable on every closed, bounded 
subinterval by Theorem 7.27. 
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For each n > 0, introduce the polynomials 


falt) = Drage, F(e)=}/ fats > — ie, 
k=0 


0 k=0 


and define 


Pa) =f sltyat, G(z) = > gh, 


k=0 


The power series G(x) converges absolutely for every x with |z| < R, 
by comparison with the series xf (x) = >, apv**!. 

To prove that F(x) = G(x) for all x with |z| < R, it suffices to 
show that if 0 <r < Rand «> 0 are arbitrary, then F —-G & A(e) 
on [—r,7]. 

Fix r < Rand «> 0. By Proposition 6.44, there exists an index NV 
such that 


fod + A(e/(2r)) on [—r, r]. 
If x € [—r,r] is arbitrary, then 


|F (x) — Fr(#)| < if |F(t) - fut) a < |ale/(2r) < €/2. 


That is, F — Fy © A(e/2) on [—r,r]. Furthermore, 


IG(e) - Fr(@)i< > 


k=N+1 
That is, Fy — G = A(e/2) on |[—r,r]. Adding these estimates, 
F-G=(F—-Fy)+(Py —G) = A(e)_ on [-7,7]. 


ak 
k+1 


[oe 
jal < |r| SO lagl [rik < 6/2. 
k=N+41 


Since e > 0 was arbitrary, F = G on |[—r,r]. Since r < R was arbitrary, 
F(x) = G(a) for all x with |z| < R. 


Example 7.42. Fix x) > 0. The geometric series 


(Example 5.61) converges on the interval |x — xo| < Zo, i-e., on (0, 220). 
Integrating term by term from Zp to 2, 
ceed (2DF (x =)" 
ae Sa = 7B mat for 0 < x < 2%. 
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Exercises 


Exercise 7.1. Using only the definition of the integral, prove that if f 
is a non-negative integrable function on [a,b], then i f => 0. Use this 
result to prove Theorem 7.16 (ii). 


Exercise 7.2. Show that 


| ae na for all real x. 
0 


Suggestion: Separate the cases x > 0 and x < 0. 


Exercise 7.3. Let f be integrable on |a,b]. Prove there exists an x 
with a < x < 6b such that 


[1 = [10 di 


Is it generally possible to choose a < x < b? 


Exercise 7.4. Let f be a function on [0, 1], and assume for every 6 with 
0<06< 1 that f is integrable on [6,1]. Give a proof or counterexample 
to each of the following: 


1 
(a) If lim f f(x) dx exists, then f is integrable on (0, 1]. 
USS 


(b) If lim(f,0*) exists, then f is integrable on [0, 1]. 


Exercise 7.5. Let a < b be real numbers, P = {t;}/ 9 a partition 
of [a,b], and f a bounded function on [a,b]. A Riemann sum of f with 
respect to P is an expression of the form 


S=> fi) At, feed, SA or t= Ly cc sivas Te 
i=l 


(a) Show that if S is a Riemann sum of f with respect to P, then 
Lf, P) < 8 <U(f,P). 


(b) Assume f is continuous on [a,b]. By Lemma 7.25, if ¢ > 0 is 
arbitrary, there exists a 6 > 0 such that if x and y are points in |a, 5] 
and |x — y| < 6, then | f(x) — f(y)| < ¢/2(b—a). Prove that if P is 
a partition such that At; < 6 for all 7, then 


b 
s — ' <e for every Riemann sum S of f with respect to P. 
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(c) Assume f is continuous. Let n > 1 be an integer, and let P = P, 
be the partition of [a, b] into n subintervals of length At = (b—a)/n. 
Prove that 


1 
lim — 


n b 
Jim — S¢ f(a +idt) = — | f(t) dt. 
41 a 


(The integral is called the average value of f on the interval [a, 0].) 
Hint: The sum on the left is a Riemann sum for f with respect 
to P, the right-hand sum. 


Exercise 7.6. Let a < b be real numbers. 
(a) Calculate the average value of f(x) = x over [a, }]. 
(b) Show the average value of f(x) = x? over [a,b] is (a? + ab + b*)/3. 


(c) Let n > 0 be an integer. Calculate the average value of f(x) = x” 
over [a, b]. Express your answer in a form that reduces, when n = 2, 
to the formula in part (b). 


Exercise 7.7. Suppose f is integrable on [a, b], and let 


= 1 u 
f= f foe 


be the average value of f on [a, 0]. 


(a) Prove that the integral of f — f over [a,}] is equal to 0. 


(b) (The Mean Value Theorem for integrals) Prove that if f is contin- 
uous on [a,b], there exists a number c in (a,b) such that f(c) = f. 


(c) If f(x) = 2? on {0, 1], find the value of ¢ in (0,1) that satisfies the 
Mean Value Theorem for integrals, and carefully sketch f and its 
average value. 


Exercise 7.8. Let f be integrable on some open ball B,(xo). 


(a) Prove that if 0 < |h| <r, then 


1 xoth 
h ie i 


is the average value of f on the closed interval with endpoints x 
and 2% + h (even if h < 0). 
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(b) Assume f is continuous at zo. Prove that 
1 roth 


lim — f(t) dt = f (2p). 


h0 A Jo 


(c) Show by example that the result of part (b) is generally false if 
f is discontinuous at 29. 


Exercise 7.9. Suppose |f| is integrable on [a,b]. Is f necessarily inte- 
erable? Give a proof or counterexample. 

Exercise 7.10. Let P = {t;}"_, be a partition of [a,b]. The points t;_1, 
t; = $(ti1 + t,), and t; are called, respectively, the left-hand endpoint, 
the midpoint, and the right-hand endpoint. The corresponding Riemann 
sums (see Exercise 7.5) are the left sum LEFT(f, P), the midpoint sum 
MID(f, P), and the right sum RIGHT(f, P). The average of the left 
and right sums is the trapezoid sum TRAP(f, P). 


(a) Prove that if f is non-decreasing on [a,b], then for every parti- 
tion P, 


b 
LEFT(f, P) < / f <= RIGHT (7, P): 
What inequalities hold if f is non-increasing? 


(b) Show that TRAP(f, P) is the sum of the areas of the trapezoids 
bounded by the secant lines joining the points (ti, f(ti)). 


(c) Prove that MID(f, P) is the sum of the areas of the trapezoids 
bounded by arbitrary non-vertical lines passing through the points 


(:, f(&)). 


Suggestion: Show that every such trapezoid has area f(t;) At;. 


Exercise 7.11. In each part, let f(x) = x? on [a,b], and let P = {a,b} 
be the partition with one subinterval. 


(a) Calculate the left, right, trapezoid, and midpoint sums, and illus- 
trate each sum with a sketch. 


(b) Show that (TRAP(f, P)+2MID(f, P))/3 is the exact value of the 
integral. 


Exercise 7.12. In each part, let f(x) = x? on [a,b], and let P = {a,b} 
be the partition with one subinterval. 


(a) Calculate the left, right, trapezoid, and midpoint sums. 
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(b) By how much does (TRAP(f, P) +2 MID(f, P)) /3 differ from the 
exact value of the integral? 


Exercise 7.13. Let p be a continuous, non-negative function on an in- 
terval [a,b]. The weighted average of an integrable function f is defined 


~ (f 0) / (>) 


State and prove the analog of the Mean Value Theorem for integrals 
for weighted averages. 


Exercise 7.14. Let 0 < a < b be real, and let p(x) = x. Calculate the 
weighted average of each of the following on |a, }]: 


(a) f(@v)=1. (bd) f(@)=a.  (e) f(a) = 2’. (dd) f(z) = 2”. 
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Differentiation 


8.1 Differentiability 


Definition 8.1. Let X be a non-empty set of real numbers, f : X > R 
a function, and xj € X an interior point; that is, there exists a 6 > 0 
such that Bs(xo) C X. 

For 0 < |h| < 6, put = 7) +h, and define the difference quotient 

i= _ 
Af (Gosh) = f (xo + ) f(xo) _ f(x) F(xo) 
«wL— XO 

If Af (xo, h) has a limit as h > 0, we say f is differentiable at xo, and 
call the limit 


= am £02) = (a0) 


xL—->xXO 4 oe) Xo 


f' (wo) = Jim Af (ao, h) = fim f(to+ a — f (zo) 


the derivative of f at xo. 
If X is open and f is differentiable at x9 for each x) in X, we say 
f is differentiable on X. 


Remark 8.2. The difference quotient Af (xo, h) represents the “average 
rate of change” of f on the interval between xp and x = xj +h, namely, 
the change in f on this interval divided by the length of the interval. 

To say f is differentiable at x) means these rates of change approach 
a finite limit as h — 0, in which case the derivative represents the 
“instantaneous rate of change” of f at x9. 


Example 8.3. If f is a constant function on some open interval X, 
then f is differentiable on X, and f’(xo) = 0 for all x. Indeed, every 
difference quotient of f is zero. 
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Example 8.4. The signum function sgn is differentiable on the set 
X =R \ {0} of non-zero real numbers, and sgn’‘(a) = 0 for all x in X, 
but sgn is not constant. 


Example 8.5. The identity function v is differentiable on every open 
interval, and since every difference quotient of 1 is equal to 1, we have 
u'(xo) = 1 for all xo. 


Example 8.6. A quadratic polynomial f(x) = ao + a2 + a22? is dif- 
ferentiable on R, and f’(x%9) = a1 + 2a2%9. To prove this, we calculate 


f(x) — f{zo) = (ag + ax + Agu”) — (ag + 129 + a2v2) 
rt — XH XL — Xo 
a; (x — Zo) + a2(2? — 2) 


= ror = a; + do(4@+ Xo), 


provided x # xo. Fixing xg and taking the limit as 7 + 29, we have 


f'(vo) = lim fl) — flo) = lim a, + a(x + 20) = ay + 2agZp. 
L—>XO «wt — Xo xL—->XO 
Example 8.7. The square root function f(x) = ./x is differentiable 
n (0,00), and f’(x9) = 1/(2,/%0). Fix xo > 0; for |h| < xo, we have 


V Xo ae — V0 _ V XO +h = V%0 VU JX 
h LO ; Jo 


nes cee, 1 


— A(Veoth+ Veo) Veotht+ xo 


Since the square root function is continuous, 


1 1 
: = lim A = lim ‘ 
f'(Zo) ion f (zo, h) = n-10 Jip PA+ Eo 2./Bo 
The square root function is not differentiable at 0. First, 0 is not 
an interior point of the domain X = [0,00). However, even if we let 
h -» 0 from the right, the difference quotient Af(0,h) = Vh/h = 1/Vh 
diverges to oo. 


Af (xo, = 


Local Extrema 


Definition 8.8. Let f : X > R, and let x) € X be a limit point. We 
say Xo is a local minimum of f in X if there exists a 6 > 0 such that 
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f (xo) < f(x) whenever x € X and |x —2o| < 6. The real number f(z) 
is called a local minimum value of f in X. 

If instead |x — xo| < 6 implies f(x) < f(x), we say 2 is a strict 
local minimum of f. 

Analogously, we define local mazimum and _ strict local maximum 
points of X. A local extremum of f in X is a point that is either a local 
minimum or local maximum. 


Example 8.9. On the set X = [0, 1], the function f(7) = x has a local 
minimum at 0 and a local maximum at 1. 

On the open interval (0,1), the function f(x) = x is bounded, but 
has no local extrema. 


Proposition 8.10. If f : [a,b] > R is a continuous function, and xo is 
a local extremum of f in X, then x is one of the following: 


(i) An endpoint of |a, }}. 
(ii) An interior point at which f'(xo) does not exist. 
(iii) An interior point at which f'(xo) = 0. 


Proof. Suppose xo is a local extremum. If x is an endpoint, or if 
f'(xo) does not exist, there is nothing to prove. Assume, therefore, 
that x € (a,b), and 


exists. We may assume without loss of generality that xo is a local 
minimum; if not, replace f by —f. By definition of a local minimum, 
f(xo) < f(x) for x & xo. That is, the numerator of the difference 
quotient is non-negative. 

Letting x — xo from the left, i.e., taking 7 — x9 < 0, we find that 
f'(ao) < 0. Letting x > xo from the right, i-e., taking x — x9 > 0, we 
find that f’(ro) > 0. Thus f’(ao) = 0. 


Derivatives and o-Notation 


Proposition 8.11. A function f is differentiable at an interior point xo 
if and only if there exists a real number m such that 


f(ao th) & f(ao) + mh+o(h) forh 0, 


and in this event, m= f'(20). 
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Proof. By definition, f is differentiable at x) and m = f’(xo) if and 
only if 


0 = tim Lot) = So) i S20 +A) = F(@o) mh 


h-0 h h-0 h 


Again by definition, f(vo + h) — f(ao) — mh & o(h) for h & 0. 


Remark 8.12. If f is differentiable at xo, the first-degree polynomial 
pi(x) = f (ao) + f’(a0)(x — 20) is called the linear approximation of f 
at Xo. 

The linear approximation is the unique polynomial p of degree 1 
satisfying f(x) © p(x) + o(x — xq) for x & 29. 


Proposition 8.13. If f is differentiable at x9, then f is continuous 
at Xo. 


Proof. Let f be differentiable at xp. By Proposition 8.11, 
f(x) © f(wo) + f'(xo)( — to) + o(@ — xo) 


~ f(xo) + o(1) for x & ao. 


Example 8.14. The converse of Proposition 8.13 is false. The ab- 

solute value function, f(a) = |z|, is continuous everywhere, but not 

differentiable at 0: 

f(h) — (0) _ |hl 
h—0O h 

which has no limit at 0. As noted in Chapter 6, a “typical” continuous 

function is nowhere differentiable. 


Af (0,h) = = senh, 


Geometric Interpretation 


Definition 8.15. Let f be a real-valued function defined on some ball I 
centered at Zo. 
If 7; € J and x; # 2, the line with equation 


y = f (20) AC ie AC 


L1— XO 


is called the secant line through (29, f(xo)) and (21, f(a1)). 
If f is differentiable at x9, the line with equation 


y = f (to) + f'(%0)(% — 20) 


is called the tangent line through (xo, f (20). 
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Geometrically, the secant line through (zo, f(2o)) and (a1, f(x1)) 
“approaches” the tangent line through (xo, i (xo)) as 21 > Lo. 

Proposition 8.11 also has a geometric interpretation: Differentiating 
a function f at x 9 amounts to “zooming in on the graph with factor 
infinity.” To justify this claim, write yo = f(xo) and introduce Carte- 
sian coordinates (h,k) with origin (xo, yo). That is, put c = zo +h and 
y = yo +k. In the (h,k) coordinate system, the graph of f has equa- 
tion k = f(a +h) — f(x). Zooming in by a factor of A sends (h, k) to 
(Ah, Ak) = (h,k). The equation of the graph in the scaled coordinates 
(h, k) is therefore k/X = f (ao + h/A) — f(xo), or (using (h, k) to denote 
the scaled coordinates) 


— (f(%o+h/A) — f (xo) 
he A, 
(h/A) 
Now, h/A + 0 as \ > ov, so if f is differentiable at xo, the equation 


of the graph in scaled coordinates “approaches” k = f'(xo) - h, the 
equation of the tangent line in the original (h, k) coordinate system. 


Loosely, the graph of a differentiable function is made up of infinitely 
many infinitesimal line segments, and the slope of the segment at xo 
is f’(xo), the “rise over the run at 29.” 


Remark 8.16. A functional relation y = f(x) determines the “depen- 
dent variable” y in terms of the “independent variable” x. In Leibniz 
notation, a difference quotient is denoted Ay/Az. If f is differentiable, 
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the limit of Ay/Azx as Ax — 0 is denoted dy/dx rather than f’(x), and 
is viewed as a (formal) ratio of infinitesimals. Computational formulas 
below may be viewed as granting license to manipulate infinitesimal 
ratios as if they were ordinary (real) fractions, see Exercise 8.11. 


Derivatives as Functions 


So far, we have concentrated on differentiability at a single point. Ulti- 
mately, we are interested in functions that are differentiable everywhere 
in their domain. From now on, our notation changes to reflect this. 


Definition 8.17. Let X be an open set in R. A function f: X > R 
is differentiable on X if f'(a) exists for every x in X. The function 
f' : X > R is called the (first) derivative of f, and f is said to be 
an antiderivative of f’. If f’ is a continuous function, we say f is 
continuously differentiable on X. 

If the derivative f’ is itself differentiable, we say f is twice differ- 
entiable on X, and denote the derivative of f’ by f”. The function 
f" : X > Ris called the second derivative of f. If the second deriva- 
tive of f is continuous, we say f is twice continuously differentiable 
on X. 

Higher-order derivatives are defined inductively. We say f is n times 
differentiable on X if the nth derivative function f) exists at each 
point of X, and we say f is n times continuously differentiable if f'” is 
continuous on X. 

If f is n times differentiable for every n > 1, we say f is infinitely 
differentiable, or smooth, on X. 


Remark 8.18. Not every differentiable function is continuously differ- 
entiable, see Exercise 8.15. For simplicity, most functions we work with 
are smooth. The nth derivative of a smooth function is automatically 
continuous by Proposition 8.13. 

In more advanced work, including applications to differential equa- 
tions, the degree of differentiability is an important detail. A function f 
is said to be of class @”" on X if f is n times continuously differentiable 
on X. A smooth function is said to be of class @° on X. 


8.2 Differentiation Rules 


Theorem 8.19 (Linearity of the derivative). Suppose f and g are dif- 
ferentiable at x, and let c be a real number. The functions f+g and cf 
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are differentiable at x, and 
(ftg)'@e)=fle)tg'e), — (cf)'(e) =e f(z). 


Proof. By hypothesis, there exist real numbers f’(a) and g’(x) such 
that 

flath)» f(z) +h f(z) + 
g(a +h) & g(x) + hg'(x) + ofh) 


Adding, 
(f+g)(a@t+h) = (f+9)(a) +h (f(z) + 9'(a)) + ofA). 


By Proposition 8.11, this simultaneously proves f + g is differentiable 
at x and shows the derivative is f’(x) + g'(z). 
The proofs for f — g and cf are entirely similar. 


Theorem 8.20 (The product and quotient rules). If f and g are dif- 
ferentiable at x, then fg is differentiable at x, and 


(f9)'(x) = f'(x) g(x) + flx)g'(2). 
If g(x) £0, then f/g is differentiable at x, and 


Proof. By hypothesis, 


fla+h)s fle) +hfila)+o(h)| , oo 
g(x + h) g(a) + hg'(x) + o(h) | 


Multiplying these approximations gives 


(fo)(a +h) = [f(z) +h f(x) + o(h)] [9(@) + hg'(x) + off) 
= (f9)(x) +h [f'(e)g(a) + f(@)g'(a)] + off). 


By Proposition 8.11, this establishes the product rule. 
For quotients, algebra and the preceding substitutions give 


AGG [Ae +h) ite) 


glu-+h) g(x) 
1 Ae + h)g(a) — fle)g(a + a) 
g(a + h)g(@) 
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Since g is differentiable at x, g is continuous at x, so g(x +h) > g(x) 
as h + 0. 


Corollary 8.21. Let n > 0 be an integer. 
(i) f(x) = 2” is differentiable for all real x, and f'(x) =nx"™*. 
(ii) g(x) =x is differentiable for all x 40, and g'(x) =—nx~""!. 


Proof. (i) Here we let x° = 1 and 0x7! = 0 even if x = 0. With this 
understanding, f(x) = x° is a constant function, so f’(z) =0 = nz"! 


for all x ifn =0. 

When n = 1, f(x) = x is the identity function 1. As noted above, 
fa) —Tane* “tor all seal a: 

Assume inductively for some n > 1 that the derivative of f(x) = x” 
is f(x) = na"~!. Taking g(x) = x and using the product rule, the 
derivative of (fg)(x) = x"t? is 


(f9)'(x) = f'(a)g(z) + f(a)g"(x) = (na®™) -e+2"-1= (nt Da”. 


(ii) Let g(a) =a" = 1/z" = 1/f (x). By the quotient rule, 


n 
£) = ag tae tar? +---+a,2"= YS aga* 
0 
k=0 


is differentiable on R, and 


p(x) = ay + Qagx + 3agz" + ---+ naz! 
n n-1 
= S- ka,v* = Silk + Lapin”. 
i k=0 


Since p! is itself a polynomial, p is smooth, i.e., infinitely differentiable. 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


8.2. DIFFERENTIATION RULES 163 


Example 8.23. Every rational function is smooth in its natural do- 
main: If p and q are polynomials and f(x) = p(x)/q(x), then f is 
differentiable for all real x with q(x) 4 0, and f’ is a rational function 
with the same natural domain as f. For example, 


d 1 | 2x 

drl+a2 9 (1+?) 

Ge eee eg) Lee 
dv 1 +a? (1+ x?)? (14+ 42)" 


Theorem 8.24 (The chain rule). Let g and f be composable functions. 
If f is differentiable at x and g is differentiable at y = f(x), then gof 
is differentiable at x, and 
(go f)'(@) =9'(F(@)) - fe) = 9) - f@). 
Proof. By hypothesis, 
f(ath)®& f(x) +hf'(x)+o(h) forhs0, 
gly +k) = gly) +kg'(y) +o(k) for k= 0. 
If we write y = f(x) andy+k= f(x+h), then 
k= f(a+h)— f(x) &h f'(x) + o(h). 
Thus k & O(h) for h & 0, so o(k) © o(h). Consequently, 
(gof)(a+h) — (9° f)(x) = gy +k) — gy) 
~ k g'(y) + o(k) 
~ (h f(x) + o(h)) g'(y) + o(h) 
~hg'(f(x)) f(x) + o(h). 
By Proposition 8.11, (go f)’(z) = 9'(f(«)) - f/(2). 
Example 8.25. The derivatives of 


f(x) =(1—2")", and g(x) 


I| 
a. 
Ke 
Ae 
8 
bo 
N—_” 
3 


(n an arbitrary integer) are 
n—-1 2 
oa 2\n—1 Piss x Le 
f(a) =n -2*)""(-22), g(xj=n (5) Gee 
Remark 8.26. The preceding functions would be all but impossible to 


differentiate without the chain rule; the only recourse would be to mul- 
tiply out and differentiate term by term. 
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Differentiability of Inverse Functions 


Theorem 8.27. Let X be an open interval in R, and ff: X > R 
a strictly monotone function. If f is differentiable at some x in X, 
then the inverse g = f~' is differentiable at yo = f (xo) if and only if 
f'(xo) #0, and in this event 


yo tk = f(xo + h) 


yo = f (Zo) 


Figure 8.1: The difference quotient of an inverse function. 


Proof. For every real number h such that 79 +h = x € X, we may 
write y = f(x) = f(a +h) and k = y— yo = f(xo +h) — f(xo), see 
Figure 8.1. Since f is injective, k is uniquely determined by h, and 
since f and f~ are continuous, o(h) ~ o(k) for k = 0. By algebra, 


ING ae Nhe see f (yo + 2 — f(y) 


h =a 
f(to +h) — f(xo)  Af(xo,h)’ 


If f'(xo) #0, then 


1 1 
(F°Y' Wo) = fim ACE )(Wo. &) = him Fay = Fa)’ 


Conversely, « = f~'(f(x)) for all x in X, so if f~! is differentiable 
at yo = f (xo), the chain rule implies 


1 = (f~')'(yo) - f(xo), 
and therefore f’(x%o) 4 0. 
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Example 8.28. Let q be a positive integer, and let f(x) = x4 for x > 0. 
The function f is increasing (hence invertible) and differentiable, with 
derivative f’(z) = qr?! > 0. The inverse function is the gth root 
function, g(y) = y!/4. By Theorem 8.27, g is differentiable at y = x4, 


and j i j 
IY) =a ea yO. 
f(x) qatt gq 
Combining with the chain rule, if p is an integer and if f is the power 
function f(x) = «?/4 = («/2)?, then 
f(x) = plalaye-? . 2g Q/9-1 = Pp lola)-1, 
qd qd 


8.3. The Mean Value Theorem 


Theorem 8.29 (The Mean Value Theorem). Let f : [a,b] + R be a 
continuous function that is differentiable on (a,b). Then there exists 
an xo in (a,b) such that 


/ (0) — f(a) 
F(t) = b-a — 

Remark 8.30. The superficial conclusion of the Mean Value Theorem 
has a plausible interpretation in terms of position and speed: If on a 
car trip you cover 60 miles in a certain one-hour period of time, then 
at some instant during that hour your speed must have been exactly 
60 miles per hour. 

However, the true power of the Mean Value Theorem arises because 
if x and y are arbitrary real numbers with a < x < y < b, we can 
apply the Mean Value Theorem to f on the interval [x,y]. That is, 
when traveling from Point A to Point B, your average speed over an 
arbitrary time interval is equal to your instantaneous speed at some 
instant during that interval. 


Proof. Assume first that f(a) = f(b). (This special case is known as 
Rolle’s theorem.) By the Extreme Value Theorem, there exist points 
Lmin ANd Fax in [a,b] such that 


J Guin) = Fe) < Ff tmex) forall ein[a,b). 
Suppose at least one of min and Zax is in (a,b), and call it x. By 


Proposition 8.10, 
f(0) — f(a) 


bq 


f'(o) =0= 
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as was to be shown. 

The only other possibility is that each of the points %pjn and Xmax IS 
an endpoint of [a,b]. But since f(a) = f(b), this means f is a constant 
function, and then f’(xo) = 0 for every point 2o in (a,b). 

This completes the proof of Rolle’s theorem. To handle the general 
case, introduce the function g : [a,b] + R defined by 


7 b-a 


The function g is continuous on [a,}|, differentiable on (a,b), and a 
short calculation gives g(a) = f(a) = g(b). By Rolle’s theorem, there 
exists an 29 in (a,b) such that g(a) = 0. But 


f(b) — fla) 
b-a 


g(x) = f'(e) - 


for all x in (a, 0). 


The Identity Theorem 


Theorem 8.31. Let f and g be differentiable functions on some inter- 
val I. If f'(x) = g'(x) for every interior point x of I, then there exists 
a real number C' such that f(x) = g(x) + C for all x in I. 


Proof. The function h = f — g is differentiable, and by hypothesis, 
h'(x) = f'(x) — g'(x) = 0 for all x in the interior of J. It suffices to 
show / is a constant function. We prove the contrapositive. 

If h is non-constant, then there exist numbers a < b in J such that 
h(a) £ h(b). By the Mean Value Theorem applied to h on [a,b], there 
exists an 2g in (a,b) such that 


h(b) — h(a) 


/ _ 
BD) = b-—a 


40. 


Example 8.32. The signum function sgnz = 2/|z|, defined for all 
x #0, has derivative identically 0, but is not constant. This example 
shows the importance of assuming the domain is an interval. 


Monotonicity 


Theorem 8.33. [f f : [a,b] > R is continuous, differentiable on (a,b), 
and if f'(z) > 0 for all z in (a,b), then f is strictly increasing in [a,b], 
and f is a bijection to the closed interval | f(a), f(b)]. 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


8.3. THE MEAN VALUE THEOREM 167 


Proof. Let x and y be arbitrary numbers such that a< a <y <b. By 
the Mean Value Theorem applied to f on [z, y], there is an xo in (2, y) 


such that 
fy) = F(2) 
y-x 
By hypothesis, f’(x9) > 0, and since x < y, it follows that f(x) < f(y). 
Since x < y were arbitrary, f is strictly increasing. 

In particular, f is injective, and the image of f is contained in 
[f(a), f(b)|: Ifa < a < b, then f(a) < f(x) < f(b). Conversely, 
if f(a) < y < f(b), the Intermediate Value Theorem guarantees there 
exists an x in (a, 6) such that y = f(z); that is, [ f(a), f()] is contained 
in the image of f. CO 


= f' (£0). 


Remark 8.34. An entirely analogous argument shows that if f is con- 
tinuous on |a,b] and f’(a) < 0 for all x in (a,b), then f is decreasing 
on [a,b], and the image of f is [f(b), f(a)]. 


Example 8.35. The polynomial function f(x) = x* — 3z is differen- 
tiable on R, and f’(xz) = 327 — 3 = 3(x — 1)(x + 1). Since f'(x) > 0 
if « < —1, f is strictly increasing on the closed interval (—oo, —1l]. 
Further, the image of f on this interval is the interval (—oo, 2], since 
f(x) — —oo as x + —oo and f(-1) = 2, Figure 8.2. 

Since f’(x) < 0 if —1 <a <1, f is strictly decreasing on the closed 
interval [—1, 1], and f maps this interval to [—2, 2]. 

Similarly, f is strictly increasing on [1,00), and f maps this interval 
to [—2, co). 


Figure 8.2: Branches of f~! for f(x) = 2° — 3z. 
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It follows from this analysis that f : R — R is surjective; the 
equation y = x? — 3x has at least one solution x for every real y. In 
fact, we have shown more. If |y| < 2, the equation y = x° — 3x has 
precisely three solutions: one less than —1, one between —1 and 1, and 
one greater than 1. If y = +2, there are precisely two solutions (one 
being +1). If |y| > 2, there is exactly one solution of y = x? — 32. 

We have also demonstrated the existence of a unique continuous 
function g : (—o0o,2] + (—oo,—-1] satisfying g(x? — 3x) = 2 for all 
x < —land g(y)? — 39(y) = y for all y < 2. The function g, a so-called 
branch of f~+, is differentiable in the open interval (—oo, 2), and 


(y) 1 1 1 
g = = = . 
f(@)  3(@—-1) 38(g)?- 1D) 
Similarly, there is a continuous branch of f~' from [—2,2] to [—1, 1], 
and a continuous branch of f~' from [—2, 00) to [1, 00). 


Convexity 


Definition 8.36. A function f : [a,b] + R is convex if, for all numbers 
x and y witha <2 <y<b, we have 
_ Fy) — Fle) 


f(z) < f(a) 4 ae (z—2) forallz withr<z<y. 


If the preceding inequality is strict, we say f is strictly convex. 


Remark 8.37. Geometrically, f is convex if the graph of f lies on or 
below every secant line of the graph. 

We say f is concave if —f is convex, i.e., if the graph of f lies on or 
above every secant line of the graph. 


Definition 8.38. Let f be continuous in some neighborhood of a real 
number 2. We say the point (xo, f (20) on the graph of f is an inflec- 
tion point of the graph y = f(x) if “the concavity of f changes at xo”, 
namely, if there exists an open ball B,(2o) such that f is strictly convex 
on (Xo — 7,29) and strictly concave on (20,29 + 1), or else is strictly 
concave on (29 — Tr, Zo) and strictly convex on (2, 2% +1). 


Lemma 8.39. [f f is continuous on [a,b], vanishes at the endpoints, 
and is twice-differentiable on (a,b), with f"(x) > 0 for all x in (a,b), 
then f(z) <0 for all z in (a,b). 
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Proof. Assume contrapositively that there exists a z in (a,b) with 
f(z) > 0. It suffices to prove f”(x) < 0 for some z in (a,b). By the 
Mean Value Theorem applied to f on [a, z], there exists a y; in (a, z) 


such that 
fy -1O=1@ _ 1, , 


z—aa z—aA 


Similarly, there is a point y2 in (z,b) with f’(y2) < 0. 


| 
| 
| 
a Y4 Zz Yo b 


Applying the Mean Value Theorem to f’ on [yi, y2], there is an x 
in (y1, y2) such that 


F'(y2) — f(y) f 
Y2—- V1 


Theorem 8.40. /f f is twice differentiable on [a,b], and f"(z) > 0 for 
all z in (a,b), then f is convex on {a, b]. 


0. 


f"z) = 


Proof. Fix arbitrary numbers x < y in [a, 6], and consider the function 


By construction, g(x) = g(y) = 0 and g” = f” > 0. Lemma 8.39 
implies g(z) < 0 on [x,y]. Since x < y were arbitrary, f is convex. 


Remark 8.41. The absolute value function is convex on R, but is not 
even once differentiable. That is, convexity does not imply f” > 0, see 
also Exercise 8.18. 


Corollary 8.42. If f is continuous on |a,b], twice-differentiable with 
f"” => 0 on (a,b), and if f” = 0 only at isolated points in (a,b), then 
f is strictly convex on |a, b]. 


Proof. Fix x < y in [a,b]. In the notation above, it suffices to prove 
g(z) < 0 (strict inequality) for x < z < y. By Theorem 8.40, g < 0 
in (x,y). However, g cannot be identically zero, because g” = 0 only 
at isolated points. Thus, g(zo) < 0 for some 2p in (2, y). 
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Since g is convex by the theorem, 


g(2) < g(x) + SV 8 (9) = Mea) <0 


for x < z< z. A similar argument shows g(z) < 0 if 7 <z<y. 


Example 8.43. The function f(z) = x° is twice-differentiable, and 
f"(x) = 6x. By Corollary 8.42, the graph of f has an inflection point 
at the origin. 


Example 8.44. The function f(z) = 2x4 is twice-differentiable, and 
f"(x) = 122? > 0 for all real x, with equality only if z = 0. By 
Corollary 8.42, f is strictly convex on R. 


Exercises 


Exercise 8.1. Find all the derivatives of the following functions: 
(a) s(x) =x — (x°/3!). (b) c(x) = 1 — (x?/2!) + (x4 /4!). 
(c) f(x) = 1+ 2+ (27/2!) + (x?/3!). 


Exercise 8.2. Let n > 0 be an integer, and f(x) = x". Find all the 
derivatives of f, expressing them in terms of factorials and powers of x. 
In particular, show that f((x) = n!, and that f(x) =0 for k > n. 
Suggestion: Calculate derivatives “by hand” until a pattern emerges. 
Then use induction to prove this pattern is correct. 


Exercise 8.3. Let f(x) = (1+a)!/? for x > —1. Find all the derivatives 
of f. Express f)(0) in terms of factorials. 


Exercise 8.4. In each part, let f(x) = (1 — x?)?. 


(a) Find the intervals of monotonicity and convexity of f, the zeros 
of f, and any local extrema and inflection points. Use this informa- 
tion to sketch the graph y = f(z). 


(b) Use the techniques of Example 8.35 to find corresponding branches 
of f~+. Be specific about the domain and image of each branch, and 
whether each branch is an increasing or decreasing function. 


(c) Solve the equation y = f(x) for x in terms of y. Match each 
formula you find with a branch of f~' found in (a). 
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Exercise 8.5. In each part, let f(x) =1/(1+ 2”). 


(a) Find the intervals of monotonicity and convexity of f, the zeros 
of f, and any local extrema and inflection points. Use this informa- 
tion to sketch the graph y = f(z). 


(b) Use the techniques of Example 8.35 to find corresponding branches 
of f~!. Be specific about the domain and image of each branch, and 
whether each branch is an increasing or decreasing function. 


(c) Solve the equation y = f(x) for x in terms of y. Match each 
formula you find with a branch of f~' found in (a). 


Exercise 8.6. In each part, let f(x) = 2/(1+ 27). 


(a) Find the intervals of monotonicity and convexity of f, the zeros 
of f, and any local extrema and inflection points. Use this informa- 
tion to sketch the graph y = f(z). 


(b) Use the techniques of Example 8.35 to find corresponding branches 
of f~!. Be specific about the domain and image of each branch, and 
whether each branch is an increasing or decreasing function. 


(c) Solve the equation y = f(x) for x in terms of y. Match each 
formula you find with a branch of f~' found in (a). 


Exercise 8.7. In each part, let f(x) = 2/(1 — 2?) for e 4 +1. 


(a) Find the intervals of monotonicity and convexity of f, the zeros 
of f, and any local extrema and inflection points. Use this informa- 
tion to sketch the graph y = f(z). 


(b) Use the techniques of Example 8.35 to find corresponding branches 
of f~+. Be specific about the domain and image of each branch, and 
whether each branch is an increasing or decreasing function. 


(c) Solve the equation y = f(x) for x in terms of y. Match each 
formula you find with a branch of f~' found in (a). 


Exercise 8.8. In each part, let f(z) = 1/V1+4 x7. Find the intervals of 
monotonicity and convexity of f, the zeros of f, and any local extrema 
and inflection points. Sketch the graph y = f(z). 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


172 CHAPTER 8. DIFFERENTIATION 


Exercise 8.9. Let f(x) = (1 — x)a?/%. Find the intervals of mono- 
tonicity and convexity of f, the zeros of f, and any local extrema and 
inflection points. Use this information to sketch the graph y = f(z). 


Exercise 8.10. Let m and n be positive integers, and let f be the 
polynomial function f(z) = (1—2x)"(1+<2)™. Find the intervals of 
monotonicity of f, the zeros of f, and any local extrema. Use this 
information to sketch the graph y = f(z). 


Exercise 8.11. Match each Leibniz notation formula with the cor- 
responding proposition or theorem from this chapter, and specify the 


appropriate functional relationships. 
d(cy + z) dy | dz dz dz dy 
— = 


Oe ede Fg ga AUS Gee dae 
d(uv) dv du dx 1 

b = , a. = S— 

(b) dx “ac de (d) dy dy/dx 


Exercise 8.12. Let f be a twice continuously differentiable function; 
that is, f” exists and is continuous. Assume f(zo) > 0, and define 


g(x) = 1/f(x) provided f(x) 4 0. 


(a) Find a formula for g” in a neighborhood of x9. Your formula should 
depend only on the values of f and its first two derivatives at 20. 


(b) If f”(a) > O what (if anything) can you say about the sign 
of g(x)? What if f”(aq) < 0? 


Exercise 8.13. Let f be twice continuously differentiable. Assume 
f'(xo) #0, so that f is invertible near xo, and set yo = f (20). 


(a) If g is a branch of f~! satisfying g(yo) = 20, prove that g is twice 
differentiable at yo, and find an expression for g” in a neighborhood 
of yo. Your formula should depend only on the values of f and its 
first two derivatives at Xo. 


(b) If f”(ao) > O what (if anything) can you say about the sign 
of g"(yo)? What if f” (ao) < 0? 


Exercise 8.14. Let f be a differentiable, convex function on |a, b], and 
let P be an arbitrary partition. Prove that 


MID(f, P) < / "f < TRAP(S,P), 


(see Exercise 7.10 for the definitions) and illustrate with a sketch. 
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Exercise 8.15. Let w: R — R be a smooth, non-constant, 1-periodic 

function. (That is, w is infinitely-differentiable, and W(x + 1) = Y(a) 

for all real x. We prove in Chapter 11 that such functions exist, for 

example, 7(r) = sin(27x).) Define f(x) = 2?W(1/zx) if « # 0, and 

f(0) = 0. 

(a) Prove that w is bounded, i.e., there exists a real number M > 0 
such that |~(x)| < / for all real x. 


(b) For x 40, calculate f’(x) in terms of w(x) and 7~'(x). Prove that 
f' is bounded. 


(c) Prove f’(0) exists, but f’ is discontinuous at 0. 


Exercise 8.16. With notation as in the preceding exercise, define 
f(x) = x*(1/x?) if e 4 0, and f(0) = 0. Prove that f is differen- 
tiable on R, but f’ is unbounded in every neighborhood of 0. 

Exercise 8.17. Let J be an interval and f : J > R a non-decreasing 
(hence integrable) function. Assume a € J, and let F be the definite 
integral of f from a. This exercise establishes that F' is convex, namely 


cea 


BU) Sa 


(a) Show that convexity of F' is equivalent to 
1 . 1 ° ; 
(io f. téerallke <7 <n ZF, 
z—-2 J, y—zJ, 


and use monotonicity of f to establish this condition. 


(F(y) —F(x)) for alla<z<yinI. 


(b) Prove f is strictly increasing if and only if F' is strictly convex. 
Caution: f need not be continuous on any interval. 


Exercise 8.18. Let f be the function constructed in Exercise 6.16, and 
let F’ be the definite integral of f from 0. Prove that F' is continuous, 
increasing, and strictly convex, but fails to be differentiable at every 
rational number. Suggestion: Use Exercise 8.17. 


Exercise 8.19. Let f be a differentiable function, @ a non-vertical 
line through an arbitrary point (xo, f (xo)), and ¢ > 0 arbitrary. This 
problem constructs a differentiable function g that (i) differs from f 
everywhere by at most «, and (ii) has @ as a tangent line. 


(a) Define d(x) = x/(1+27). Calculate ¢’, and determine the absolute 
maximum and minimum values of @. 
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(b) Let m be an arbitrary real number, and define ¢,,(2) = (mz). 
Show that the line y = mz is tangent to the graph of ¢,, at « = 0. 


(c) Let n > 0 be an integer, and define W(x) = 4¢(nx). Prove that 
(i) The line y = mz is tangent to the graph of y, at the origin, and 
(ii) For sufficiently large n, |q,(ax)| < e for all real x. 


(d) Let f: R > R be differentiable, and ¢ a non-vertical line through 
an arbitrary point (xo, f(2o)) = (70, yo) on the graph of f. 


By scaling and shifting the function ~ constructed in part (c), prove 
that for every ¢ > 0, there exists a differentiable function g, defined 
on the same set as f, such that (i) g(a) = f(o), (ii) The line 2 is 
tangent to the graph of g at (xo, yo), and (iii) |g(x) — f(x)| < e for 
all x in the domain of f. 


In words, by perturbing f by an arbitrarily small amount in the vertical 
direction, you can make the graph tangent to an arbitrary line. Thus, 
we have no visual basis for saying any particular line is mathematically 
tangent to any particular graph. 


Exercise 8.20. (Darboux’s theorem, a.k.a. the Intermediate Value 
Property for Derivatives) Let f : J > R be differentiable, and assume 
a < bare points of J satisfying f’(a) < f’(b). 

Prove that if & is a real number such that f’(a) < k < f’(b), there 
exists an x in (a,b) such that f’(x) = k. 
Caution: We do not know f’ is continuous. Instead, apply the Extreme 
Value Theorem to the differentiable function g(x) = f(x) — kx on the 
interval [a,b], and use the assumptions on the endpoint derivatives to 
show that neither endpoint is an extremum. 


Exercise 8.21. Let f be differentiable on some open ball B,(x 9). Prove 
that if the one-sided limits lim(f’, x9 ) and lim(f’, zj) exist, then they 
are both equal to f’(29). 
Hint: Show that if a one-sided limit exists but is unequal to f’(z0), 
then Darboux’s theorem (preceding question) is false. 

In words, a derivative cannot have a jump discontinuity. 


Exercise 8.22. Let f be continuous on some open ball B,(ao), differ- 
entiable on the deleted ball B* (a9), and assume the one-sided limits 
lim(f’, 29 ) and lim(f’, 7g) exist and are equal. Prove f is differentiable 
at 2%, and f’(zo) = lim(f’) 25.) = lim(7’; 29). 

Hint: Apply the Mean Value Theorem to intervals contained in B,(20) 
and having xo as an endpoint. 
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Exercise 8.23. Find all values of a1, a2, 61, bo such that the function 


a2 
a+— «<-l, 
x 


ek A sg? -l<a2<l, 


b 
b+ din yf 
x 


is differentiable on R. 


Exercise 8.24. This exercise outlines l’Hépital’s rule, a computational 
procedure for evaluating certain indeterminate limits of the form 0/0. 
The technical tool is the Cauchy Mean Value Theorem, given in part (a). 
Throughout, f and g denote real-valued functions. 


(a) Assume f, g are continuous on some interval |a,b] and differen- 


| 
tiable on (a,b). Prove there exists a point z in (a,b) such that 


b) 
f'(2)(90) - 9(a)) = o'(z)(F0) — f(@)- 
b 


Hint: Apply Rolle’s Theorem to the function h : [a,b] + R defined 
by h(x) = f(x) (9(b) — 9(a)) — g(x) (F(0) — fa): 


(b) Suppose f and g are differentiable in some deleted neighbor- 
hood X of xo, that g is non-vanishing in this neighborhood, and 
that lim(f, 29) = lim(g, 79) = 0. 

Prove that if lim(f’/g’, xo) = @, then lim(f/g,20) = @. (In English: 
When attempting to evaluate a limit of a quotient, if the answer 
is formally 0/0, try differentiating the numerator and denominator 
and re-evaluating. If the limit is 2, then the original limit was also @.) 


Hint: Setting f(xo) = 0 and g(xo) = 0 extends f and g continuously. 
If 6 > 0 is chosen so that Bs (ao) C X, use the Cauchy Mean Value 
Theorem to write 

f(to+6) _ f'(z) 


g(x + 4) . g'(2) 
for some z between 2% and x9 + 6, then take the limit as 6 —> 0. 


(c) Suppose f and g are differentiable and g is non-vanishing on some 
interval (R, oo), and that lim(f, oo) = 0, lim(g, 00) = 0. Prove that 
if lim(f’/9’, co) = @, then lim(f/g, co) = @. 

Hint: For x > R, define F(x) = f(1/x?) and G(x) = g(1/z?), then 
show part (b) can be applied at 0. 
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Exercise 8.25. In each part, let r be a rational number and c > 0 real. 
Use l’Hopital’s rule (Exercise 8.24) to evaluate the stated limit. 


If r is a positive integer, check that your result agrees with the 
geometric series formula. 


(b) i (a7 ae yr = (2c*)" 


2c C—C 


Exercise 8.26. Let f be defined in some neighborhood of 2. 
(a) Assuming f is differentiable at xo, evaluate 


lim f (xo + h) — f(to =k) 
h0 2h 


(b) If the limit in part (a) exists at xo, does it follow that f is differ- 
entiable at x9? Continuous? 


Exercise 8.27. Let f be twice-differentiable in a neighborhood 2. 


Evaluate 
r f(xo +h) + f(ao — h) — 2f (xo) 
im . 
h—0 h? 


Why do we not use this limit to define f”? 
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The Fundamental Theorems 


Theorem 9.1 (The first fundamental theorem of calculus). Let f be 
an integrable function on [a,b], and let F' be the definite integral 


= is f, defined for x in {a, bj. 


If f is continuous at xo in (a,b), then F is differentiable at xo, and 
F'(xo) = f(xo). In Leibniz notation, 


< [10 dt = f(x) if f is continuous at x. 


F(a) = f ” f(t) at 


Xo a Xp to +h 


Proof. If x9 + h lies in (a,b), then 


Tamera 


Since f is continuous at x, f(x) © f(ao) + o(1) for x & 2, so 


AF (Zo, h) = 


1 zoth 
AF (ao, h) © a (f(v0) + 0(1)) © f(ao) +01) for h 0. 


177 
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Letting h > 0 shows F"(xo) = f (x0). 


Theorem 9.2 (The second fundamental theorem of calculus). Let F’ be 
continuously differentiable on some open interval I. Ifa € I, then 


[ P@a=Fe)-F@ for all x in I. 


a 


Proof. Consider the definite integral 


G(x) = [ F'(E) dt. 


By the First Fundamental Theorem, G is differentiable in J, and 
G'(x) = F’(x) for all x in J. By the identity theorem, there exists a 
real number C' such that G(x) = F(x) +C. To evaluate C, set x = a: 
0 = G(a) = F(a) + C, so C = —F(a), or G(x) = F(x) — F(a). 0 


9.1 Integration by Parts and Substitution 


Loosely, the fundamental theorems assert that integration and differ- 
entiation are inverse operations. Consequently, the product rule and 
chain rule for differentiation each correspond to an integral formula. 


Proposition 9.3 (Integration by Parts). Jf u and v are continuously 
differentiable on |a, b], then 
‘ b 
/ 
- i, vu. 


b 
/ uv’ = wv 
a 


Proof. By the product rule for derivatives, (wv)! = u'v + uv’, or 


uv’ = (uv)’ — vu’. 


The proposition follows from Theorem 9.2 by integrating each side 
over |a, 0]. 


Theorem 7.22 has a useful, far-reaching generalization. 


Theorem 9.4 (Change of variables). Let a < b be real numbers, T a 
continuously differentiable function on |a,b], and f a continuous func- 
tion whose domain contains the image of tT. Then 


[t= front 
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Remark 9.5. In Leibniz notation, put t = T(s), so that dt = 7'(s) ds. 
The conclusion of the theorem reads 


7(b) b 
/ BGS Gem / f(r(s)) -7'(s) ds. 
T(a) a 
Proof. Consider the continuously differentiable functions 


T(s) 


cm= fF Fi)=(Gon(s)= ft 


T(a 
By the chain rule and the First Fundamental Theorem, 
PSG) se Sj (for) es: 


By the Second Fundamental Theorem, 


[or=Fo-re@= [r= front 


9.2 Taylor’s Theorem 


Definition 9.6. Let f be n times differentiable in some neighborhood 
of xg. Define the nth degree Taylor polynomial (of f at xo) by 


i ag. 3 (a5 
FO) pg) oog LOMO) 


2! "nl 


Pn(x) = f(to)+f'(xo)(%—-20)+ (S=25)") 


and the nth degree remainder by R,(x) = f(x) — pp(2). 


Theorem 9.7. Let n be a non-negative integer. If f is (n +1) times 
continuously differentiable in some open interval X containing xo, 1.e., 
is of class @"*! near xo, then for each x in X: 


(i) (Integral form of the remainder) 
1 x 
R,(2) = = ‘) fOM(t)(w — 8)” dt. 
ie 


(ii) (Lagrange form of the remainder) There is a@ Zn41 between x9 and 
x such that 
ON Gai) 


(n+ 1)! he 


Ree) = (x — Xo 
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Remark 9.8. Philosophically, Taylor’s theorem says that on an interval 
about a point x, a function of class @"*! “behaves like a polynomial 
of degree n up to order (n + 1). Particularly, if f is smooth, then for 
each n > 0, the nth degree Taylor polynomial p,(x) approximates f(z) 
to degree (n + 1), ie., 


f(x) © p(x) + O(a — cn ae for x & Xo, 


with the constant in O bounded by the maximum of |f'"+)| on X. 
When x & 20, a larger degree corresponds to a better approximation. 


Proof. When n = 0, the integral form of the remainder comes from 
Theorem 9.2: 


F(x) — pole) = f(a) = Foo) = f feat 
Assume inductively that 
Rela) == f Fo O(e— Ha 


for some n > 0. Integrating by parts with 


w=), v(t) = Gail a ae 

WH=fr%™@, of) = Tle)" 
gives 

fern) ale ae ae : 

OS Gael eee eee 

FO) (ao) A 1 ei 2 

= ant 2) ee main I. ( +2)(t) (x — t) +1 de. 

or 


Fle) = pale) + Ral) = Peale) + aay f LM —O at 


the asserted form of R,41(z). 
To establish the Lagrange form of the remainder, note that f(t!) is 
continuous on the interval between x9 and x, so f(* achieves an 
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absolute minimum value m and an absolute maximum value M in this 
interval. By monotonicity of the integral, 


Lee of fe Le 

<< _4)\n < (n+1) _ 4\n eo _ 4\n 
af me t) dt<— J (t)(x — t) dus [ Me t)” dt, 
or 


re ere 


(x — Zo 


(x — Zo 
Re) cron E 


mm ——_ 
(n4+1)! — 
Again since f‘"+) is continuous, the Intermediate Value Theorem guar- 


antees there exists a 2,11 between xo and x such that 


fC ay) 
(n+ 1)! 


n+1 


Rn(x) = (1 — x0) 


Convexity and the Second Derivative 


In calculus, a function f is said to be convex if the graph of f “lies 
above each tangent line”. Books often assert that f is convex provided 
f" > 0. Taylor’s theorem may be used to establish this fact. Note, 
however, that the secant criterion for convexity in Definition 8.36 makes 
no assumption of differentiability (much less continuity of the second 
derivative), and is therefore both simpler and more general than the 
usual calculus definition. 


Proposition 9.9. If f” is continuous and f(x) > 0, then on some 
open ball B,(x9), the graph of f lies above each of its tangent lines. 


Proof. Since f’(x9) > 0 and f” is continuous, Corollary 6.17 guarantees 
there is an r > 0 such that if |a — xo| <r, then f"(x) > f”(ao)/2 > 0. 

Let x, be an arbitrary point of B,(xz 9). By Taylor’s theorem at 2, 
using the integral form of the remainder 


Fle) = pila) + Rule) = Fler) + Foyle) +5 fF O@- Hat 


But the graph y = pi(x) is the tangent line to the graph y = f(z) 
at x, and if |x — xo| < r, ie., if c € B,(xo), the integral is positive 
except at x1. (If x < x1, the integrand is negative but the interval of 
integration is oriented from right to left.) That is, on the open interval 
B,(ao) the graph of f lies above the tangent line at 2,. 
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9.3 Differentiation of Power Series 


Theorem 9.10. Suppose 


f(x) = D/ ax(x — 20)* 
k=0 
= ap + ay (x — 29) + Go(x — 29)" + a3(x@ — 49)? +... 


is a convergent power series with radius R > 0. The real-analytic func- 
tion f is differentiable at x for |x — xo| < R, and 


f(x) = » ka;,(x — £)*~* = Silk + 1)ay41(% — x0)” 


= ay + Qae(a — 29) + 3a3(2 — xp)? +4aa(o— 2)? +... 


Remark 9.11. Computationally, a convergent power series can be dif- 
ferentiated term by term in its interval of convergence, just as if it were 
a polynomial. 

The theorem guarantees the termwise derived series has the same ra- 
dius of convergence as the original power series. This has an important 
“bootstrapping” consequence: Since f’ is real-analytic on (—R, R), the 
second derivative f” can be represented by a convergent power series 
on (—R, R), obtained by differentiating the series for f’ term by term, 
and so forth. That is, a real-analytic function is infinitely differentiable. 


Proof. As usual, assume zp = 0. Throughout the proof, let 


inoh= S- aya", the polynomial approximators of f(x); 
k=0 
oe) = S- ka,x*', — the termwise derived series; 
k=1 


f(z) = S- ka,yx*', — the polynomial approximators of g(). 
k=l 


Our first task is to prove that the series g(x) converges absolutely for 
all x in (—R, R). By a now-familiar trick, we may write |x| = rp with 
|x| < |r| < Rand p < 1. The terms of g(x) are therefore bounded in 
absolute value by 


kage] < fagr® | - ip]. 
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By Corollary 4.79, (kp*~!) + 0, so the second factor is bounded. The 
first factor is, aside from a multiplied factor of r, the general term of 
the series for f(r), which is absolutely convergent by hypothesis. The 
derived series g(x) is therefore absolutely convergent on (—R, R), and 
consequently may be integrated term by term: 


= lim Reals Theorem 7.41 
Noo 0 

= lim f,(x) — f,(0) Theorem 9.2 

= f(a) — f(0) 


By Theorem 9.1, 


ay = = f at)at = ala) 


9.4 Improper Integrals 


Definition 9.12. An integral A; f is called a basic improper integral if 
one of the following holds: 


(i) Exactly one endpoint a or 6 is infinite, and f is bounded. 


(ii) Both endpoints are finite and f is unbounded, but only in a neigh- 
borhood of one endpoint. 


An integral is improper if the interval of integration can be divided 
into finitely many subintervals, on each of which the integral is a basic 
improper integral. 


Example 9.13. Let p > 0 be real. The following are basic improper 


integrals: 
i dx i dx i dx 
9 xP’ -3 |z|?’ 1 oP 


The following are improper, and are split into basic improper pieces: 


bea -[$ AG oh lel =a lor oar ee jal 
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Definition 9.14. (i) A basic improper integral i f is said to converge 


to L if : 
L= lim / ie 
b> 00 a 


Basic improper integrals jee f are handled similarly. 


A basic improper integral ih f with f unbounded near 6 is said to 

converge to L if . 
L= lim f. 
rb Ja 

An analogous definition is made for f if f is unbounded near a. 

A basic improper integral that does not converge is said to diverge. 

An improper integral is said to converge to L if the integral can be 
broken into finitely many basic sub-integrals, each of which converges, 
and the sum of the sub-integrals is L. Otherwise, the improper integral 
is said to diverge. 


Proposition 9.15. Let p > 0, and define f(x) = x” ifx > 0, f(0) =0. 
. "ae 
(i) The improper integral => converges if and only if p< 1, and 
ie 


the value is 1/(1 — p). 


Co 


d 
(ii) The improper integral i - converges if and only if p > 1, and 
eo 
the value is 1/(p — 1). 


Remark 9.16. We have not yet defined exponentiation with irrational 
exponents, so strictly speaking the proof below should be read as ap- 
plying only to rational exponents p. In light of Theorem 10.7 below, 
the proof below goes through without modification for arbitrary real 
p> 0. 


Proof. First suppose p = 1. The definite integral of 1/xz from 1 is the 
natural logarithm, see Definition 7.38. In Chapter 7, we showed there 
exists a real number e, with 2 < e < 3, such that 


[ dx - dx 
—=n= ees 
1 x eon & 


In particular, the basic improper integrals 


ae lee) 
ae and i a 
1 


9 « x 
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both diverge. 

If p #1, the function F(x) = x'-?/(1 — p) is an antiderivative of f 
on the set of positive real numbers. 

(i) If0 <p <1, then 1—p>0, so 


. , bee 
lim —= lim 
a0 J 2 aor Llp 


OU, ee Se, AME 
= lim = ; 
Parr a>ot lL Pp 1- Pp 


If p > 1 instead, then 1 — p < 0, and a’? > o asa — 0, so the 
integral diverges. 
(ii) If 1 < p, then 1 —p <0, so 


a 5. eee 
lim — = lim 
boo Jy eP boo 1 — Pp 


ON se | 


1 


If 0 < p < 1 instead, then 1 — p > 0, and b!-? — oo as b > ov, 80 the 
integral diverges. 


Definition 9.17. An improper integral he f converges absolutely if the 


improper integral iP |f| converges. If the integral of f converges but 
the integral of | f| diverges, the improper integral of f is said to converge 
conditionally. 


Remark 9.18. To avoid stating results with four (or more) closely- 
related parts, we focus for the rest of this section on basic improper 
integrals over an unbounded interval [a, oo). Analogous results are true 
for other types of improper integral. 


Proposition 9.19. Leta be a fixed number, and assume f, g are in- 
tegrable on every interval |a, b] with a < b. 


(i) If f is non-negative, then 
/ f converges if and only if F(x) = / f is bounded. 


(ii) If ft = max(f,0) and f— = —min(f,0), then 


/ f converges absolutely if and only if / f> both converge, 


and this implies he f converges. 
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(iii) If |g| < |f| except at finitely many points, and if I converges 
absolutely, then tg converges absolutely, and 


Proof. These assertions follow immediately from the corresponding 
facts about ordinary (proper) integrals, infinite sequences, and series. 
Indeed, if (b,) is a real sequence diverging to oo, consider the sequence 


Bea op of 


a 


and note that the improper integral of f converges to L if and only if 
every such sequence (B;) converges to L. 


Proposition 9.20. Let f be improperly integrable on [a,co), and let 
T be a non-negative, differentiable function on |a, 3) satisfying T(a) =a 
and T(x) + co asx — B-. Then 


[16)-r@a= [roa 


in the sense that the left-hand integral converges and has the same value 
as the right-hand integral. 


Proof. By the change of variables theorem for ordinary integrals, 


[se -ra= [poe 


for alla < a < 6. The claim follows by taking x > 6°. 


Remark 9.21. Generally, change of variables can be applied to improper 
integrals so long as the “new” variable x = r(t) does not achieve a value 
near which f is unbounded. 


Example 9.22. If f is continuous on [1, 00), then 


[ MPae-f ae Piear, 


t2 


in the sense that both integrals converge or diverge, and if both con- 
verge, they have the same value. 
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The Integral Test for Series 


Proposition 9.23. Let f be a non-increasing, positive, real-valued 
function, defined for x > 0. For every positive integer n, 


Ss < fis (x) de < > f(b). 


In particular, the real sequence defined by a, = f(k) for k > 0 is 
summable if and only if f is improperly integrable. 


0 k k+1 n—-1 n 


Proof. Let k > 0 be arbitrary. Because f is non-increasing, 
O0< f(k+1)< f(a) <f(k) fork<a<k+1. 


Integrating over [k,k + 1], 


k+1 
f(k+l< f(x) dx < f(k). 
k 
Summing over k = 0,...,2 —1 and patching integrals, 
n n-1 —1 
> f@®) => fR+1) < “f(e <3 fk 
k=1 k=0 0 k=0 


All three expressions are non-decreasing sequences in n, and the two 
sums differ by f(0) — f(n), a finite amount, so all three converge or 
diverge together. 
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Exercises 


Exercise 9.1. The following functions are given by their value at ft. 
Find an antiderivative, and check your answer by differentiation. 
Hints: If r is non-zero, f is differentiable, and F(t) = +f(t)’, then 


F'(t) = f(t)" 'f’(t). In part (e), it may help to use the identity 


eee © ie ee! 
ae OTS a’ 


(a,) (1+t)? (ag) t(1+¢#?)? (a3) (1+?) 

(i) a/R (bs) ORE (b3) t//2+0 

(1) (1+ vt)? (2) @+t*) (cs) (L-t*)ae+e") 

(di) (t+ vi)? (do) (Vé+1/vt? (ds) 7? +8?) + 3t)/ve 

(1) I/(-#) (e2) t/(1-#) (es) 1/((¢-1)?(1+%)) 
Exercise 9.2. Evaluate [ aay dt for x in R. 


Exercise 9.3. Suppose f : R — R is continuous. 


(a) Define G: R > R by 


Cals : f (t) dt. 
0 
Prove that G is differentiable, and find G’(z). 


Suggestion: Write G as the composition of two functions you un- 
derstand well, and use the chain rule. 


(b) Define H: R > R by 


a= / f(t) dt. 
Show that H is differentiable, and find H’(x). 
(c) Assume ¢ and w are differentiable on (a, 3), and define 


O(a) 
O(x) = [ f(t) dt for x in (a, 6). 


Show that © is differentiable, and find ’(x) in terms of f, ¢, and wv. 
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Exercise 9.4. Consider the functions F', G : R — R defined by 


2 


=. -tdt e “dt 
F(x) = ee G(x) = 
(7) 0 v1l+t (7) if Vv1+té 


(a) Calculate F” and G’. 


(b) Which is larger, F($) or G($)? Explain in detail. 


Exercise 9.5. Does there exist an integrable function f : [-1,1] ~ R 
such that 


f(t)dt = V1—<? for all x in [—1,1]? 
=| 


Explain. What if f is only required to be zmproperly integrable? 


Exercise 9.6. Let u : R — R be continuous. Prove that for each ¢ 
in R, there is exactly one @! function f : R > R satisfying the initial 
value problem 


fi=u,  f(0)=c. 


Exercise 9.7. The natural logarithm log (Definition 7.38) is the unique 
function satisfying log’t = 1/t for all t > 0 and log1 = 0. 


(a) If r £1 is rational, use integration by parts to evaluate 
fo = i; t"logtdt, «>0. 
1 


(b) Use substitution to evaluate the integral in part (a) if r = —1. 
Exercise 9.8. Let A: (—1,1) + R be the @! function defined by 


A= ei A(0) =0. 


(a) Show A is strictly increasing. 
(b) By (a), A is invertible; let S = A~!. Prove that S’ = V1 — S?. 
(c) Show that S is @?, and find S” in terms of S. 


Exercise 9.9. Use the change of variables theorem to re-prove Theo- 
rem 7.22. (Your calculation should be extremely brief. Good theoretical 
tools can be a tremendous labor-saving device.) 
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Exercise 9.10. Let f : R — R be continuous. 
(a) Define 


oS [ +0 dt, h(a) = a xf (t) dt. 


Find g'(x) and h’(z). 
Suggestion: Rewrite h so that there is no “x” inside the integral. 


(b) Use (a) to show that 


[ foe wa = [ ([ rear) du. 


Suggestion: Differentiate each side with respect to x. 


Exercise 9.11. (Uniqueness of Taylor polynomials) Let n > 0 be an 
integer, %) a real number, X an open interval containing x9 (possibly 
all of R), and f a real-valued function of class @” on X. 


(a) If g, is a polynomial of degree n and f(x) = gn(x) + 0((x — 2)”) 
near Xo, then g,, is the nth degree Taylor polynomial of f at xo. 


(b) If f is a polynomial of degree n, then the Taylor polynomial of f 
at xo is f itself, expanded in powers of (a — x0). 


(c) Use the Taylor polynomial formula to expand a general quadratic 
polynomial f(x) = ax? + bx + c in powers of (x — x). Use algebra 
to verify that the result is equal to f. 


(d) Expand f(#) = x” in powers of (x — x9). Show that the result is 
consistent with the binomial theorem. 


Exercise 9.12. This exercise gives a short (but less motivated) proof 
of Taylor’s theorem with the Lagrange remainder. Assume f is of 
class @"*+ on some interval X containing a point xv. For each x in_X, 
and each integer n > 0, define 


"(+ (n) t 
bnealt) = Fl) FOF Ole) (@—-1e-.-- -E (@ oy 
Deduce Taylor’s theorem by applying Rolle’s theorem to the function 
x —t n+1 
Frnr4i(t) = Gn4i(t) — E = “| bn+1(Xo)- 
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Exercise 9.13. The number z, in the Lagrange remainder can be writ- 
ten uniquely as a convex linear combination z, = % + tn(x — x) for 
some real number t,, with 0 < t, < 1. Effectively, using t,, rescales the 
interval between x, and x to unit length. 

Let f be of class @"*! in some neighborhood of x, and assume 
f*) (a9) 4 0. Prove 


ty + o(a — 29). 


ee wea 


Hints: By the proof of Taylor’s theorem, the (n—1)th remainder is equal 
to the (n — 1)th-degree term plus the nth remainder. Rearrange, apply 
the Mean Value Theorem to f) on the interval between 2p and 2, 
and use the fact that f+) has a non-zero limit at xp. 


Exercise 9.14. Recall that if f is integrable on some interval [a, (}, 
then the midpoint estimate (with one subinterval) is 


B 
i f(a) de x f(@)\(B-a), #=a+), 


the area enclosed by the horizontal line through the midpoint. This 
exercise bounds the error under the assumption f is of class @?. 


(a) Use the first-order Taylor approximation with xo = Z to prove that 
if | f"(x)| < Ko for all x in [a, 6], then 


B =a? 
[ @@-1@) ae] < SEE 


Hint: The integral of f’(Z)a over [a, 3] vanishes by symmetry. 


(b) Suppose f is of class @? on [a,b], and that |f’(x)| < Ke for all x 
in [a,b]. Prove that if n is a positive integer, then the error for the 
midpoint method with n subintervals of length Ar = (b — a)/n is 
at most K(b — a)3/(24n?). 


Exercise 9.15. Recall that if f is an integrable function on some in- 
terval [a, 3], then the trapezoid estimate (with one subinterval) is 


f(x) dx = 5(8 — a) (f(a) + f(8)), 
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the area enclosed by the secant line through the endpoints. This ex- 
ercise gives a bound for the error under the assumption that f is of 
class @?. 

Let F be an antiderivative of f, hence of class @?, and introduce 
the functions 


®(z) = F(a) - F(a) - 3(@ — a) (f(a) + f(a), 


(a) Show that G(a) = G(8) = 0. Conclude there exists a z with 
a<z< 6 such that G’(z) =0. 


(b) Show that G’(a) = 0. Conclude there exists a 2’ with a < 2’ < z 
such that G”(z’) = 0, and show 
F(z’) 
12 


(8 —a)* = (8). 
(c) Prove that if |f”(a)| < Ko for all x with a < x < 6, then 


x) dx — (8 — a) (f(a) + f(8))| < = (8 — a). 


(d) Suppose f is of class @? on [a,b], and that |f”(x)| < Ko for all x 
in [a,b]. Prove that if n is a positive integer, then the error for the 
trapezoid method with n subintervals of length Ax = (b — a)/n is 
at most K(b — a)3/(12n?). 


Exercise 9.16. Let f be a smooth, real-valued function on some open 
interval X, and assume there exist positive real numbers M and R such 
that 


rh oF seine 
owe <M for all z with |z — x0| < R. 


n+1)! 


Prove f is real-analytic on Br(x0), i-e., that the remainder in Taylor’s 
theorem converges to 0 as n — co. 


Exercise 9.17. In each part, f(z) = V1 +a = (1+2)'/? for «> —1. 


(a) Calculate the derivatives f(x) and f'™(0), and write out the 
Taylor series for f at the origin. (Express the derivatives in terms 
of factorials and powers of 2.) 
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(b) Show that the Lagrange form of the remainder goes to 0 in the 
interval (—1, 1) as n > oo. 


Exercise 9.18. (Newton’s binomial theorem.) Let p be a rational 
number that is not an integer. In each part, f(z) = (14+ 2)? for x > —1. 


(a) Calculate the derivatives f(x) and f'(0), and write out the 
Taylor series for f at the origin. (You may leave the derivatives in 
“open form”, as products.) 


(b) Show that the Lagrange form of the remainder goes to 0 in the 
interval (—1,1) as n > oo. 


Exercise 9.19. Suppose that the power series 


CO 
(2s ie =a aaa 
k=0 


is formally equal to its own derivative. Express the coefficients in terms 
of ao, and find the interval of convergence of the resulting series. 


Exercise 9.20. Manipulate the geometric series 


1 CO 
=Sostal+rtertaet+---, -1<ar<l, 


using differentiation and algebra, to give closed-form expressions for 
the power series: 


(a) So kak = 2 + Qn? + 30? +---, 
k=l 


(b) So Rak = 2 +40? + 803 +... 
k=l 


Exercise 9.21. Let n > 2 be an integer, 6 > 0 a real number, and 
consider the function 


fate) = { O-9) iE es 6; 


0 otherwise 


(a) Prove that f, is non-negative and of class @”~' on R. 
Suggestion: Since f(d — x) = f(x) for all x, and since f is defined 
by smooth formulas, it’s enough to consider x = 0. 
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(b) Define 


6 x 
1 
C= | falt).dt, Ee = — | fn (bydt. 
0 Cn JO 
Prove that F7, is of class @", non-decreasing, and that F(a”) = 0 if 
0, Py) ak a SO. 


(c) Assume [c,d] C (a,b). Use part (b) to show there exists a non- 
negative function f of class @" defined on R such that f(x) = 1 if 
Ce Sd. fe) 01h ee Gor b- aand 0 << F(a) 1 tor all 
real x. 


Exercise 9.22. Let f : R — R be continuous and ¢-periodic. Prove: 


(a) For every real number a, 


[40 dt = [is dt. 


(b) There exists an ¢-periodic function F' with F” = f if and only if 


[10 dt = 0. 


(c) The function 


F(x) = [4 dt — aC dt 


is ¢-periodic. 


Exercise 9.23. Determine whether or not the improper integrals con- 
verge. (Do not attempt to evaluate.) 


Exercise 9.24. Does the improper integral 


1 dx 


1 xe? 


converge? What value is obtained by ignoring the fact that the integral 
is improper? Does this value make sense qualitatively? 
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Exercise 9.25. Let f be a continuous, increasing function on some 
interval [a,b]. Use the substitution y = f(x) and integration by parts 
to prove that 


f(b) b 
Oe ORO / f(x) dx, 
f(a) a 


and illustrate with a sketch. 


Exercise 9.26. Let F' be a continuously-differentiable function on some 
interval J. Prove there exist non-decreasing functions Ff, and Fy on I 
such that F = F, — Fy. 

Suggestion: The derivative F’ = f is continuous, and therefore may 
be written as the sum of a non-negative continuous function f; and a 
non-positive continuous function fo. 


Exercise 9.27. Let F be a differentiable function on [a,b], and assume 
the derivative f = F” is integrable (though not necessarily continuous). 
Use the outline provided to give a proof of the Second Fundamental 
Theorem, 


/ f(t) dt = F(b) — Fla). 


(a) Let P = {t;}*_) be an arbitrary partition of [a,b]. For each i = 1, 
2,..., n, there exists a number ¢7 in the 7th subinterval such that 
P(ti) — Fi-1) = FG) Ati. 


(b) If the t* are chosen as in part (a), the resulting Riemann sum is 
F(b) — F(a). 


(c) If P, is a sequence of partitions whose maximum length goes 
to 0, the corresponding Riemann sums approach the integral of f 
over |a, b]. 


Exercise 9.28. Let f be a positive, non-increasing function defined 
for x > 0, and let a, = f(k) for k > 0. Use the technique in the proof 
of Proposition 9.23 to find lower and upper bounds for the tail 


Ss ae >» f(k) 


in terms of improper integrals of f. 
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Exercise 9.29. The sums of the infinite series 

aah ema aay 

a ee ee 
k=1 k=1 


are to be estimated to within ¢ = 0.5 x 10-6 by adding up finitely many 
terms. Use the preceding exercise to find a sufficient number of terms 
that guarantee this accuracy. 
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Chapter 10 


The Exponential Function 


Definition 7.38 introduced the natural logarithm log : (0,00) + R: 
a 
log x = i aut fore <0. 
1 


By Theorem 9.1, log is differentiable, with log’ x = 1/x > 0, and there- 
fore is strictly increasing by Theorem 8.33. The logarithm is surjective 
consequent to the remarkable identities 


log xy = logx + logy, log(1/z) =—logx for all z, y> 0. 
We defined the number e, with 2 < e < 3, by the condition loge = 1. 


Area = log x 
() 1 a0 


Figure 10.1: The definition of log as an integral. 


Remark 10.1. The tangent lines to the graph y = log x become arbi- 
trarily close to horizontal because log’ x = 1/x, but the graph has no 
horizontal asymptote. 


1O% 
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Figure 10.2: The natural logarithm function. 


10.1 The Natural Exponential Function 


Definition 10.2. The natural exponential function exp : R — (0,00) 
is the inverse of log. 


Remark 10.3. That is, if y is real and x > 0, then x = expy if and only 
if y =logaz. In particular, exp y > 0 for all real y. 


The Differential Characterization of exp 


Theorem 10.4. For all real x, exp’ x = expx. Conversely, if f : R—7 
R is a differentiable function such that f’ = f, then f(x) = f(0)expx 
for all x. 


Proof. For all real x, we have x = log(exp x). Since log is differentiable 
and has non-vanishing derivative, its inverse function exp is differen- 
tiable, and by Theorem 8.27, 


1 
log’(expx)  l1/expzx 


ap i= = exp x. 
Conversely, suppose f : R > R is differentiable and f’ = f. Since 
exp x > 0 for all real x, we may consider g(x) = f(x)/ exp, a quotient 
of differentiable functions. Since exp’ = exp, the quotient rule gives 
sia) = PEL) = fle\(expx) _ f'(e)= f@) 


(exp x)? exp £ 


=0 for all z. 


By the identity theorem, g is a constant function: g(x) = g(0) = f(0) 
for all real x. That is, f(x) = f(0) exp for all z. 
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Real Exponentiation 


Proposition 10.5. Ifa > 0 is real and r = p/q is rational, then 
loga’"=rloga, ie, a” =exp(rloga). 


Proof. Mathematical induction together with logry = logx + logy 
shows that log b” = mlog b for every positive real number b and every 
integer m. 

Set b = a” = a?/4, so that b? = a?. Taking logarithms and using the 
preceding paragraph, gq log b = ploga, or 


log a” = logb = (p/q) loga = rloga. 


Proposition 10.5 suggests the definition of exponentiation with ar- 
bitrary real exponent. 


Definition 10.6. If a > 0 and zx is real, we define 
a” = exp(z loga). 
In particular, e* = exp for all real x. 


Theorem 10.7. Let r be a real number, and define f(x) = x" for 
x >0. The function f is differentiable, and f'(x) = ra™!. 


Proof. By definition, f(a) = exp(r log). The chain rule gives 


f'(z) = exp'(r log x) r log’ x = 2"(r/x) = rx”. 


Theorem 10.8. Let b > 0. The function exp, x = b” = exp(x log b) is 
differentiable, and 


exp, & = (logb)exp,x for all real x. 


Conversely, if k 1s a real number and f is a differentiable function 
satisfying f’ =kf, then f(x) = f(0) exp(kx) for all x. 


Proof. If k& is real and f(x) = exp(ka), Theorem 10.4 and the chain 
rule give f(x) =kf(x). The first assertion follows by taking k = log b. 

The converse is proven analogously to Theorem 10.4, and is left to 
you, see Exercise 10.21. 


Corollary 10.9. e*T¥ = e%e” and e*¥ = (e¥)* for all real x, y. 
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Proof. Fix a real number y arbitrarily, and define f(x) = e*T¥. By 
the chain rule, f is differentiable, and f’ = f. Since f(0) = e¥, Theo- 
rem 10.4 implies e7*¥ = e*e” for all real x. 

To prove the second assertion, consider g(x) = (e¥)*. By the first 
part of Theorem 10.8 with b = e’, 


g(x) = log(e”)(e”)” = yg(z). 


By the second part of Theorem 10.8 g(x) = e®¥, since g(0) = 1. 
As a fringe benefit, (e”)” = (e”)¥, since each is equal to e*¥. 


Remark 10.10. The identity exp(x+y) = exp x exp y may also be proven 
algebraically. Set u = expx and v = expy. Applying exp to both sides 
of the identity « + y = logu + log v = log uv gives 


exp(x + y) = exp(log uv) = wv = exp xexpy. 
Corollary 10.11. [fb > 0 is real, then b*t¥ = b*bY and b* = (b*)¥ for 


all real x, y. 

The proof is requested in Exercise 10.22. 
Remark 10.12. We do not define 0° = 1 without qualification. Indeed, 
for 0 < L <1 we can “make 0° = L”. If a < 0, then 


2 
lim exp(a/z?)™ = lim (efe/2)) =e. 
x20 x0 


and similarly, lim, exp(—1/2*)” =0. 
xr 


Definition 10.13. Let b > 0 be real. The inverse of exp,, denoted 
log,, is the logarithm to the base b. 


Proposition 10.14. Fiz b > 0. We have log,x = (log x)/(logb) for 
all positive x. 


Proof. The equation y = log,x means x = bY = exp(ylogb). Taking 
the natural logarithm, y = (log x) /(log 6). 


10.2 Representations of exp 


Theorem 10.15. For all real x, 


e” = lim (1 + =)" 
n 


N—->Co 
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Proof. The theorem is obvious if x = 0. Otherwise, if 0 < h < 1/|z| 
then 1+ xh > 0. Since log 1 = 0, we may write 


1 log(1 + xh) — log1 log(1+ xh) — log 1 

— log(1 = = : 

i og(1 + xh) h x ai 

As h + 0, this approaches xlog’1 = x. Writing h = 1/n and using 
continuity of exp, 


lim (1+=)"= lim (1+ axh)'/ 


noo hor 
1 
= Ij = Jog(1 + 
ig exp [toe +28) 
= i eee = 
=e ee ee) 


Remark 10.16. Theorem 10.15 characterizes the natural exponential 
function as a limit of geometric growth. If, for example, x is the annual 
interest rate on a savings account, and there are n compoundings per 
year, then the multiplier on the right gives the factor by which the 
savings increase over one year. As the number of compoundings per 
year grows without bound, the balance does not become infinite in a 
finite time. Instead, if $1 is allowed to accrue interest with continuous 
compounding, then in the time it would take the savings to double 
without compounding, the balance increases to $2.72 (rounded to the 
nearest penny). 

Theorem 10.17. e* = S° i for all real x. 

k=0 


Proof. Let f(x) denote the sum of the power series. The coefficients 
are a, = 1/k!, and 


k+1 k! 
Ap41e = |x| es Tr |x| = 


li = ——_—___ 
ae apak Fae (K+ 1)! ksok+1 


k-oo 


Since this is less than 1 independently of x, the series converges abso- 
lutely for all «. By Theorem 9.10, the series may be differentiated term 


by term: 
/ = k-1 _ 
oy 25 a he =a e 
if 


Since f(0) = 1, Theorem 10.4 implies f(x) = e® for all x. 
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Remark 10.18. The exponential series could have been found using Tay- 
lor’s theorem since f‘”)(0) = exp0 = 1 for all n. The series can be easily 
remembered: The constant term is 1 = e°, and each successive term is 
the integral from 0 of the preceding term. 


Sl dh, Oo ies 2 

Corollary 10.19. e = y = 14 | | | +... is irrational. 
| | | | | 
ar k! 1! 2! 3!) A! 


Proof. The series representation follows by setting 7 = 1 in the expo- 
nential power series. We will show that if e is rational, then there exist 
integers N and M such that N < M < N +1. Contrapositively, since 
such integers obviously do not exist, e is irrational. 

If 2 and m are positive integers, Lemma 2.30 gives 


1 1 
< 
(tm) > G+ Da’ 


with strict inequality ifm > 1. By the geometric series formula, 


= if 1fe+1 1 i, 
- 1a) 


G+" 1-1/@+) @+)-1 & 
and so 

a ; re = 

x te (Cm) ~ 24 (¢+1)mél e-8 


for every positive integer @. Multiplying through by #!, 


=! ao. 
Det ae 


Each term ¢!/k! of the sum is an integer since 0 < k < @, so the sum 
represents some integer N(¢) depending on @. 

If e is rational, then there exist positive integers p and q such that 
e = p/q. But then N(q) = N and q!e = p(q—1)! = M are integers, 
and the preceding inequality implies N < M < N+ (1/q) < N+1. 
Clearly, no such integers M and N exist. 
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Remark 10.20. The preceding proof shows that for every integer ¢ > 1, 


L 
1 1 1 
= (3) " 20-al rA(sra): 


For example, taking @ = 10 gives a rational estimate for e that is 
accurate to within « = 1/(20- 10!) = 1/72, 576,000 < 1.4 x 107°: 


_, 197, 282, 021 
~ 72.576, 000 


+ A(e) & 2.718281815 + A(e). 


(To fifteen decimals, the value of e is 2.71828 1828459045... .) 


10.3. Hyperbolic Functions 


Definition 10.21. The hyperbolic cosine and hyperbolic sine functions 
are defined to be the even and odd parts of exp, respectively: 
eae Se. 


cosh. = =pe>? sinh x = 


The hyperbolic tangent and hyperbolic secant functions are defined by 


sinha e*—e”* 1 
tanhz = = , sech x = : 
cosha e*+e-% cosh x 


Remark 10.22. The functions “cosh” and “sech” are pronounced pho- 
netically; sinh is pronounced “cinch” or “shine”, and tanh rhymes with 
“ranch”. As the notation suggests, these functions have a close kinship 
with the circular functions of ordinary trigonometry. 


Proposition 10.23. The functions cosh, sinh, tanh, and sech are de- 
fined for all real numbers, and satisfy the identities cosh? — sinh® = 1, 


cosh’ = sinh, sinh’ = cosh, tanh’ = sech?. 
cosh maps [0,0o) bijectively to [1,oo). sinh maps R bijectively to R. 
tanh maps R. bijectively to (—1,1). 


Every point (x,y) on the right nappe of the hyperbola x? — y? = 1 is 
of the form (cosht, sinh t) for a unique real t. 
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Figure 10.4: Hyperbolic tangent and secant. 


Proposition 6.47 and the power series for exp immediately give series 
expansions for cosh and sinh. 


Proposition 10.24. For all real x, 


oo gtk fig at 7 

hz=) 2 =1 bein 
Sener dBi a al 6 
oO gtk+ fina 7? rl 
me La Ok FI YT BET BT 
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Proposition 10.25. For all real x and y, 


cosh(x + y) = cosh xcoshy + sinh x sinh y, 


sinh(x + y) = cosh zsinhy + sinh xcoshy, 
tanh x + tanh y 
1+tanhztanhy 


tanh(2 + y) = 


Inverse Hyperbolic Functions 


Proposition 10.26. The inverse hyperbolic functions are as follows: 


cosh”! x = log(x + Vz? — 1), col 
sinh”! x = log(x + Vz? + 1), x real; 
1l+2 
l-«¢ 


1 
tanh = Slog ( iF -l<a<l. 


Their derivatives are 


+1 
(cosh™')/(x) = a. ole 
x?—1 
(sinh~')/(2) = es x real; 
(2a ae it , 
1 
24 _ 
(tanh \'(x) = ta -l<a<l. 


Remark 10.27. Because cosh is even, the two branches of cosh~! must 
be negatives of each other. By the difference of squares identity, 


g—-v227-1= 


SO: forge: 1: 


1 
c+ Vx —1 


so indeed, log (x + Vax? — 1) = log (x + Vx? — 1). Similar arguments 
show sinh’ and tanh! are odd. 


Proof. If x > 1, then z = coshy = (e¥ +e”) /2 if and only if 
(e%)? — (Qr)e¥+1=0. 
This is a quadratic in e¥. By the quadratic formula, e¥ = «+ V2? — 1, 


or 
y = cosh”! x = log (x + Va? — 1). 
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Similarly, x = sinh y = (e¥ — e-¥)/2 if and only if 
(e¥)? — (Qr)e¥ -1=0. 
The quadratic formula gives eY = « + Vz? + 1, or 
y = sinh”! x = log(« + Vx? +1). 


There is no sign ambiguity because only this choice leads to a real- 
valued function when 2 is real. 


Finally, 
a eet eW%¥-1 
eT tev w+ 


if and only if re +2 =e” —1, or e*# = (1+2)/(1—2), or 


1 1 
y= tanh"! ¢ = 5 to ( **). 


2 1-2 


The derivatives are found by direct calculation. 


10.4 Factorials 


An Exponential Estimate 


Factorials are closely connected with the natural exponential function. 
The following is a weak version of Stirling’s formula. 


Proposition 10.28. [fn > 1 is an integer, then 
e/8 (=) Vii <n!<e(=) Jn. 
e€ € 


Proof. Integrating by parts with u = log x, we have 


n 


/ logadx = xlogx — x = nlogn ~ n+ 1=log (=e). 
1 


f=] 


The natural logarithm function is concave, so its graph lies above every 
secant line and below every tangent line. 
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y = loge 


1 kK k+1 a 


Figure 10.5: Secant line approximation of the integral. 


Subdivide [1,n] into n — 1 subintervals of length 1. The total area 
enclosed by the resulting secant lines is smaller than the integral of log, 
so we have 


4 (log 1 + log 2) + $(log 2 + log3) +--+ + 4(log(n — 1) + logn) 
=-—tlogn+ Y logk = log (=) < log (Se). 
2 > Jn en” 


Exponentiating and rearranging gives the asserted upper bound for n!. 


| 
| 
| 
| 
| 
| | 
t t 
1 kK k+1 n 
Figure 10.6: Tangent line approximation of the integral. 
For each integer k = 2, 3, ..., n — 1, construct the trapezoid of 
width 1 whose top edge is the tangent line to the graph y = log at k. 


The area of this trapezoid is log k. 
The remaining pieces of integral are bounded above by 


1/2 1/2 n 
/ logrdr < [ (cx —1) dx = 1/8, / logxdx < (logn)/2. 
1 1 n—(1/2) 


The total area of these regions is 


n-1 n ! 
yt Zlognt+  ) logk =} —jlogn+ 5 logk = log (*. =) 
k=l k=I 
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mn” n! 
] —. < | renee , 
= e :) = (« = 


and rearranging gives the asserted lower bound for n!. 


Consequently, 


The Gamma Function 


The Gamma function is a “smooth interpolation” of factorials for pos- 
itive real numbers. The treatment here follows an exercise in Rudin. 


Lemma 10.29. For every real number x > 0, t™/e' + 0 as t + ov. 


Proof. The series representation for e' guarantees that ifn > xv > 0 is 
an integer and t > 0 is real, then e’ > t”*!/(n + 1)!. Consequently, if 
t > 0, then t”/e’ < t"/e’ < (n+ 1)!/t, and the upper bound goes to 0 
as t + Oo. 


Proposition 10.30. For every real x > 0, the improper integral 
i rte "at 
0 


Proof. Since et < 1 for t > 0, 


1 1 1 
eee) t? dt =, 
0 0 zt 


so the improper integral on the left converges. 
If n > x—1 is a positive integer, then e’ > t”*?/(n + 2)! for t > 0 
by the same idea as in the proof of Lemma 10.29. Thus 


[ tetas | Metdt < (n+2)! f t? dt = (n+ 2)!, 
1 


ar 1 


converges. 


so the improper integral on the left converges. 


Definition 10.31. The Gamma function T : (0,00) > R is defined by 


Egy) = | Pe" dt. for > 0: 
0 
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The main result of this section is a characterization, due to Bohr and 
Mollerup, of [ in simple abstract terms. 


Theorem 10.32. The function T’ satisfies the following properties: 
(i) [(a@+1)=aI(2) for all x > 0. 


(ii) [(n +1) =n! for all integers n > 0. 
(iii) log I is conves. 
Conversely, if f : (0,00) + R satisfies these properties, then f =T. 


Proof. (i) Fix b > 0. Integrating by parts with u = t* and dv = edt, 
t=b 


b b 
i t?e dt = —t®e"| +2 | foe dE 
0 t=0 0 


b 
Saher + of Pe dk. 
0 


By Lemma 10.29, —b*e~° — 0 as b > 00, so 


T(¢+1)= ‘: fe dS of t® te dt = aI (2). 
0 


0 


(ii) If mn = 0, we have 


boo 


Tin+1)= | e'dt = lim —e 
0 


By part (a) and mathematical induction, [(n + 1) =n! for n > 0. 
(iii) If | + | = 1, then the integrand of le -- ) may be written 


“5 ; etote) = (EP ne ©) a (t-te) hn 


Since t?~'e > 0 for t > 0, Hélder’s inequality (Exercise 10.27) implies 


SS 1/p oo 1/q 
reps (fevers) [rea resin 


Taking logarithms, 


log T(a) + | log ['(y), 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


210 CHAPTER 10. THE EXPONENTIAL FUNCTION 


which is the desired convexity statement. 

Conversely, suppose f : (0,00) > R satisfies (a), (b), and (c), and 
set p = log f. Property (a) says p(x+1) = y(x)+log x for x > 0; that 
is, the difference quotient of y on [y, y + 1] is logy. By induction on n, 


(=) p(t +n+1) = (2) + log((n + x)(n — 1l+2)---(1 + x)z). 


Property (b) says y(n + 1) = log(n!) for every positive integer n and 
(c) says vy is convex. 

Fix a positive integer n. For 0 < x < 1, consider the four points 
n<n+1l<n+1+2 < n+2. Since ¢ is convex, the difference quotients 
of y on the intervals [n,n + 1], [p+1,n+1+4+ a], and [n+1,n +2] are 
in non-decreasing order, i.e., 


yp(n+1+2)—-y(n+1) 


logn < 


< log(n + 1). 
Multiplying by x and substituting (*), 
tlogn < v(x) + log((n+2)(n-—1+42)---x) —log(n!) < rlog(n + 1), 


or 


0 <y(x)—1 asic Sion (tase 
=r “et(e@+l)...(etn—-D(e@tn-~ i a 


As n — oo, the upper bound goes to 0, so 


n!n* 
nooo ¢(a+1)...(e+n-—1)(4+n) 
for 0 < a <1. By property (a), y satisfies this equation for all x > 0. 
We have shown that if f satisfies properties (a)—(c), then log f is 
the limit on the right. Since [ satisfies (a)—(c), the limit on the right 
must be equal to log T(z). 


Remark 10.33. In particular, we obtain the equation 
nl n® 
he) f ll 
(2) nso a(@+1)...(2+n—l)(e@+n) ie 


analogous to the characterization of exp in Theorem 10.15. 


Corollary 10.34. Ifa > 0, then | Pte Vda? T(z); 
0 


Proof. Making the substitution t = au, 


| pep eaae af u* 'e “du = a* - T(z). 


0 0 
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Exercises 

Exercise 10.1. Let a, b, and c be positive real numbers. Is it more 

sensible to agree that a’ is equal to (a’)* or to a), or does it matter? 

Exercise 10.2. Prove that 2!°8¥ = y'°8* for all x, y > 0. 

Exercise 10.3. (a) Let n and N be positive integers. Prove that 
n<logiy,N<n+1 ifandonly if 10°<N< 10°", 


if and only if N is an integer having n+1 digits. In words, the integer 
part of the base 10 logarithm of N is one less than the number of 
digits of N. 


22” 
(b) Which is larger, 22” or 10°’? About how many digits does 
each number have? 


Exercise 10.4. Fix b > 1, and define a sequence (x,)?2.) by 
tea le Seas Ho Mork 0. 
Thus 2; = 6, x9 = b°, tz = pe” and so forth. 
(a) Prove that if (x,) > @, then bf = &. 
(b) Use part (a) to determine the set of b for which (x;,,) converges. 


(c) Show @ increases with 6, and find the largest possible value of @. 
Suggestion: Express b as a function of £. 


(d) Two people are arguing. One says that if b = 2, then ¢ = 2, since 
Jr = 2; the other says ¢ = 4 because Ja = 4. Who (if either) is 
correct, and why? 


Exercise 10.5. Let wu be differentiable. Find the derivative of exp ou, 
and the derivative of log o|u| at points where u is non-zero. 


Exercise 10.6. Let n be a positive integer, and define f(a) = x"e~* 


for x > 0. Prove f has a maximum value, and find it with justification. 
Exercise 10.7. Let f(x) = e~*(x? — 1) for z real. 


(a) Sketch the graph of f, using information about the first two deriva- 
tives to determine intervals on which f is monotone, convex, and 
concave. 

Suggestion: Introduce symbolic constants to simplify calculations. 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


212 CHAPTER 10. THE EXPONENTIAL FUNCTION 


(b) Let y be real. Determine, with justification, how many solutions 
does the equation f(x) = y has. (The answer depends on y.) 


Exercise 10.8. Finish the proof of Proposition 10.26 by calculating 
the derivatives of cosh7', sinh~*, and tanh7’. 


Exercise 10.9. Establish the given identities: 
(a) cosh(sinh't) = V#2 +1.  (b) sinh(cosh7't) = V#?—1,  |[t| > 1. 


Exercise 10.10. Use the substitution wu = sinht to show 


| Vu? + 1du = $(ava? +14 log(x + Vx? +1)). 
0 


cosht 

Exercise 10.11. Evaluate Vu? —1du. 
1 

Exercise 10.12. Evaluate / sech? x dx. 


Exercise 10.13. For x > —1 real, define 
zt? x t 
P= | a® =. TR 
Which is larger, F'(1/2) or G(1/2)? 


Exercise 10.14. Let n > 0 be an integer. Show that 
1 
| (log x)" dx = (—1)"nl. 
0 


Exercise 10.15. Prove that | e~* dt converges. (Do not evaluate.) 
0 


Co 


Exercise 10.16. Granted that / e~” dx = \/z, evaluate: 


(a) [ — dx =1(1/2). (b) i: etl” dx (a> 0). 


(c) | are?” da and | are? I” da (a > 0). 
0 


—oo 
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Exercise 10.17. Use appropriate substitutions and algebra to evalu- 
ate: 


(a) lim zlogz. (b) lim 2. (c) lima*.  (d) lim(1 +2)". 
r—0F £—0t LOO L300 


Exercise 10.18. Define f(x) = x” for x > 0. 
(a) Calculate f’, and find lim(f’, 07). 


(b) Prove that f has a unique minimum, and find the location and 
value of the minimum. 


] n 
Exercise 10.19. Let n > 0 be an integer. Prove that lim oe: a0 
&%—>00 x 
Exercise 10.20. Determine (with proof, of course) which of the fol- 


lowing converge; do not attempt to evaluate the sums! 


@) G) ses, oO Daa 
@ po ) =. 


n=1 n=1 
Hint for (a): Use the preceding exercise, and “borrow” a small power 


of n to nullify the log. 


Exercise 10.21. Complete the proof of Theorem 10.8: If k is a real 
number and f is a differentiable function satisfying f’ = kf, then 
f(x) = f(0) exp(kaz) for all x. 


Exercise 10.22. Prove Corollary 10.11: If b > 0 is real, then b7*¥ = 
b*bY¥ and b*” = (b*)¥ for all real z, y. 

Exercise 10.23. Use the exponential estimate to find lower and upper 
bounds for (2n)!/(n!)? that do not contain factorials. 

Exercise 10.24. Using the estimate of Remark 10.20, what is the 
smallest number of terms guaranteeing an accuracy € < 0.5 x 107100? 


Exercise 10.25. Define f : R > R by 
exp(—1/z”) ifx>0 
fay ee 
0 ifx <0 


Prove that f)(0) exists and is equal to zero for all k > 0. 
Suggestion: First use induction on the degree to prove that for every 
polynomial p, 

lim p(1/x) f(z) = 0. 


Then show inductively that every derivative of f is of this form. 
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Exercise 10.26. This question asks you to mimic the estimates in the 
proof of Proposition 10.28 for the function f(x) = 1/zx on the interval 
[1,n], with n > 1 an integer. 


(a) Use secant lines on the intervals [k, k + 1] to show that 


n—-l 
1 1 1 
] = =U pe rato 
ce al (<3) unos 


(b) Use tangent lines at k = 2, 3, ...,n—1, and suitably handle the 
intervals at the ends, to show that 


n—-1 1 i 
] 24 log n. 
og 3/ ( :) om < logn 


k=2 


n 


1 
(c) Prove that pa —logn is increasing and bounded above. 


(The limit is called the Euler-Mascheroni constant, y.) 


Exercise 10.27. This exercise outlines a proof of Holder’s inequality: 
If p, g > 1 are real numbers such that : + - = 1, and if f and g are 
integrable on |a, b], then 


[ols fi(fi) (fia) 


(a) Let 0 <a<1. Prove that ¢* < at+ (1— a) for all t > 0. 


(b) Let 6 =1-—a, so that 0 < 8 < 1. Prove that 
uv? < aut Bu for all u, v > 0. 
Suggestion: Set ¢ = u/v in part (a). 
(c) Let p> 1, and set q = p/(p— 1), so that : + ; = 1. Show that 
AB< aa + qe for all A, B > 0. 
Suggestion: Use part (b) with appropriate changes of variable. 


(d) Prove Hélder’s inequality. Suggestion: Use part (c) with A and B 
suitable integrals. 
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Exercise 10.28. This exercise outlines a second proof that e is ir- 
rational. The argument is more involved than the proof in the text, 
but generalizes easily to show e is transcendental (not the root of a 
polynomial with integer coefficients). 


(a) Let q be a polynomial with integer coefficients and smallest-degree 
term cox™. Use a property of the T-function to show that 


1 [oe) 
mT / q(x)e* dx 
is an integer of the form co + (m + 1)(integer). 


(b) Let m > 0 be an integer. Let g(x) = «(x — 1)™*1, a polynomial 
having integer coefficients and smallest-degree term (—1)™*1z™. 
Show that 


e [* = 1 [* = 
= | oe "an= ae q(x + l)e™® dz, 


ml 


and use part (a) to deduce that this integral is an integer multiple 
of m+ 1. 


(c) Let ¢ > 0 be arbitrary. In the notation of part (b), show that there 
exists an m such that 


ce 


1 
< | q(aje "dx <e. 
0 


m! 


(d) Suppose a9 # O and a, were integers such that aj + aje = 0. 
Multiplying through by the integral of q(a)e~*/m!, we would have 


C= “of q(x)e* dx + af q(x)e* dx 
0 0 


m! m!) 
ioe) 1 lee) 
a aye aye 
= eu q(a)e * dx + al q(x)je * dx + ti g(aje * dx: 


By part (b), the third summand is an integer multiple of m+ 1. 


Show that for m sufficiently large, the first summand would be an 
integer not divisible by m+ 1 by part (a), and the second summand 
would be smaller than 1/2 by part (c). This is impossible, so our 
assumption that ag + a,e = 0 (with ap 4 0) was incorrect. 
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Exercise 10.29. This argument, adapted from Klein’s Evanston Col- 
loquium, generalizes the preceding exercise, showing that e is not the 
root of a polynomial equation with integer coefficients. 


Suppose there exist integers ag #0, a1, ..., @, such that 
(*) 0 = ao tae +++ + ane” = ao + S— aye*. 
k=1 


Throughout, & denotes an integer such that 1 <k <n. 


(a) Let m > 0 be an integer, and consider the polynomial 
m m+1 
q(z) = 2™((a@ — 1)(@-2)...(e@-—n))"™. 


Show that the smallest-degree term of q(x) is ((-1)" nl)" 2, and 
that the smallest-degree term of g(a +k) has degree m + 1. 


k oo 
(b) Use (a) to show — / q(x)e * dx is an integer divisible by m+ 1. 
Mm. Sr 
(c) Let ¢ > 0 be arbitrary. Prove there exists an m such that 


k 
| Gane de <<: 


m! Jo 


e* 


Hint: There is an M > 0 such that |(x —1)(a—2)...(t—n)| <M 
for 0 < x < k (why?), so e*|q(x)e~*| < e®k™M™™1" 


(d) If (*) holds, then 
1 > cP fe 2 
: m! (o 7 = rie I eee 


= ao o —z . a,e* si —# d 
oan q(x)e oe, : q(vje-* dx. 


Obtain a contradiction, if m is sufficiently large, as follows: Each 
integral in the sum may be decomposed as 
k k 


k lo) 
paul | q(a)e~* dx + a i, q(zje- dz: 
0 Mm: Sk 


ml! 


By part (c), the first integral is smaller than 1/(2n) for sufficiently 
large m (so the sum over k is smaller than 1/2), and by part (b) the 
second is an integer multiple of m+ 1. But for m sufficiently large, 
the “ao” summand is not a multiple of m+ 1. 
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Circular Functions 


Trigonometric functions are usually introduced via geometry, either as 
ratios of sides in a right triangle, or in terms of points on the unit 
circle. Our analytic development loosely follows Ahlfors. The primary 
advantage over a geometric approach is that definitions are based on 
the axioms of R. Fringe benefits include easy generalization to complex 
variables, and illustration of solving differential equations by power 
series. 


11.1 Sine and Cosine 


Theorem 11.1. There exist unique twice-differentiable functions C 
and S:R—- R satisfying 


CHhES0: 3CG)ei 0 
S"+8=0, S(0)=0, S(0)= 


Definition 11.2. The function C' in Theorem 11.1 is called the cosine 
function, cos: R > R. The function S is called the sine function 
sin: R-> R. 


Proof of Theorem 11.1. (Existence). Suppose provisionally that there 
exists a real-analytic solution y of the second-order differential equation 
y” + y = 0 in some neighborhood of 0. Write 


CO 
y(x) = 5 ayx® = ag +042 + ant? +..., 
k=0 


217 
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and use term by term differentiation to deduce that 


y (2) = So (B+ Vania’, 


yl" (0) = S[k + 2 k+ Yansa®. 
By assumption, y satisfies 


Oxy" ty =D K+ (K+ Vanyoe" +S ape! 


k=0 k=0 
=S [kh +2)(k + lanss + ay] 2. 
k=0 


The coefficients of this series must all be zero by the identity theorem 
for power series (Theorem 6.45), so we get a recursion relation 


Qk, 


= ——___—_—_ forallk > 0. 
Ak42 (kt D(k4+1) ora >0 


The initial conditions y(0) = ao and y/(0) = a, determine the first 
two coefficients. The first two coefficients, together with the recursion 
relation, determine all the remaining coefficients: 


ioe (—1)*ao S (—1)*a 
ee (2k)! ’ oF OR ey 


The respective initial conditions for C (a9 = 1 and a, = 0) and S$ 
(a9 = 0 and a, = 1) give 


oO 2k 2 4 6 
Ze 7 eo ee 
C= 2) (2k)! Dal gh se 
k=0 
Ss g2ktl 7 7? at 
sl ai Qk+Hhi °° Oot! 
=0 


To determine the interval of convergence for each series, apply the 
ratio test. For C(x), we have 


ght? /(2k + 2)! 
ak /(2k)! 


_y, Pk)! _ Ja? 


= ~ poo (2k +2)! ksoo (2k + 2)(2k + 1)’ 


k-oo 
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which is 0 for all real x; that is, the series for C(x) converges absolutely 
for every real x. The calculation for Sa) is similar. 

In summary, there exist real-analytic functions C' and S satisfying 
the conditions of Theorem 11.1. 


(Uniqueness). The existence proof implicitly showed that the condi- 
tions of Theorem 11.1 uniquely define real-analytic functions C' and S. 
However, there could conceivably be non-analytic solutions. 


Lemma 11.3. Let y : R > R be a twice-differentiable function sat- 
isfying y” +y = 0 on R. If y(0) = y/(0) = 0, then y(x) = 0 for 
all x. 


Proof. If y” + y = 0 for all real x, then 
((y'? +97)’ = 2y'y” + 2yy! = 2y'- (y+ y) =0. 
By the identity theorem, the function (y’)? + y? is constant: 


y (x)? + y(x)? = y'(0)? + y(0)? = 0 for all real 2x. 


In particular, y(x) = 0 for all real «x. 


We now complete the proof of uniqueness. Let a and 0b be arbi- 
trary real numbers, and assume f is any twice-differentiable function 
satisfying f” + f =0, f(0) =a and f’(0) = b. The function 


y(x) = f(x) — (aC(x) + bS(2)) 


is easily shown to satisfy y” + y = 0, y(0) = 0, and y’(0) = 0. By the 
lemma, y(x) = 0 for all real z, ie., f(z) = aC(x) + bS(z). 

That is, the differential equation f” + f = 0 and the conditions 
f(0) =aand f’(0) = b uniquely determine f. This completes the proof 
of Theorem 11.1. 


For later use, we record the final step of the proof: 


Proposition 11.4. Let a and b be real numbers. If f is a function 
satisfying f" + f =0, f(0) =a and f'(0) =b, then 


f(x) =acosx+bsinz for all real x. 


Theorem 11.5. The sine and cosine functions satisfy the following 
identities for all real x, y: 


(i) cos(—x) =cosz, sin(—x) = —sinz. 
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(ii) sin’(a2) = cos(x), cos'(a) = —sin(z). 
(iii) sin? 2 + cos*z = 1. 


(iv) cos(x + y) = cosxcosy — sin x sin y, 


sin(a + y) = sinycosz + sin x cos y. 
In particular, sin(2x) = 2sinx cosx and cos(2x) = cos? x — sin? x. 


Proof. (i) It is apparent that sin is an odd function from its power 
series; however, a direct proof (in the spirit of the theorem) can be 
given using Proposition 11.4: The function f(z) = sin(—2) satisfies 
f’ +f =0, f(0) = 0, and (by the chain rule) f’(0) = —1, so f = —sin. 
Evenness of cos is similar. 

(ii) If f = sin’, then f”+f =0 by differentiating sin” + sin = 0. But 
f (0) = sin’ 0 = 1 by definition of sin, and f’(0) = sin’(0) = —sin0 = 0. 
By Proposition 11.4, sin’ = cos. A similar argument shows cos’ = — sin. 

(iii) Consider the function f = sin? + cos. Part (ii) gives 


f’ = 2sinsin’ +2 cos cos’ = 2 sin cos +2 cos(— sin) = 0, 


i.e., f is constant. Thus f(x) = f(0) = sin? 0 + cos?0 = 1 for all z. 

(iv) To prove the addition formulas, fix a real number y and consider 
the function f(z) = sin(~+y). The chain rule gives f” + f = 0, and the 
derivative formula for sin implies f’(x) = cos(a# + y) for all x. Substi- 
tuting x = 0, we find f(0) = siny and f’(0) = cosy. Proposition 11.4 
with a = siny and b = cosy gives 


sin(x + y) = f(x) =sinycosx + sin x cosy 


The addition formula for cos is similar. 


Several auxiliary formulas are listed here for reference. These need 
not be memorized, but their technique of proof is worth remembering. 
Corollary 11.6. For all real x and y, 

+ cos(# + 


cos x cosy = 5(cos(x — 


y) 
y) 


1 
2 ( 

sina sin y = $(cos(x 
5(sin(« + y) + sin(a — y)); 

cos 7 + cosy = 2. cos 


sin x cosy = 


cos x — cosy = 2sin 


sinx + siny = 2sin 


ce Oe Re RE 
NIE NIE pole 
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Proof. From the addition theorem for cos and the fact that sin is odd, 


cos(x — y) = cosa cos y + sin x sin y, 


cos(a + y) = cosxcosy — sinxsiny. 


Adding and subtracting these (and dividing by 2) gives the first two 
formulas. The third is derived similarly from the addition theorem 
for sin. 

To derive the fourth, write the first as 


cos(u + v) + cos(u — v) = 2cosucosv. 


Pd, = (x+y) and v = $(x—y), noting that r = u+v and y =u-v. 
The fifth and sixth formulas are similar. 


Periodicity 


Proposition 11.7. There exists a unique real number a, with 


V2<a</6-V12, 


such that cosx > 0 for -—a <a <a and cosa = 0. 


Proof. To prove there exists a smallest positive root a of the cosine 
function, we establish the estimates 


3 
x 4 
tps ne Se for all real x > 0, 


2 2 4 


Bi x 
a ae for all real x. 


The identity sin? t + cos?¢t = 1 implies —1 < cost < 1 for all real t. 
Integrating from 0 to x, with x > 0 arbitrary, gives 


x 


=sing <2. 


—4“4< | cost dt = sint 
0 t=0 


Since x > 0 was arbitrary, —t < sint < ¢t for all t > 0. Integrating this 
from 0 to x gives 


i 


G ig 
-S<f sintdt = 1—cosz < —, 
Be Ao 2 
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and since x > 0 was arbitrary it follows that 1 — (t?/2) < cost <1 for 
t > 0. Another integration (and renaming of variable) gives 


ps 
B= SSeS for 7 > 0, 
and a fourth gives 77/2 — 24/24 < 1—cosxz < 27/2, or 
2 2 4 
(i Se i Se for x > 0. 
2 2 24 
This inequality is true for x < 0 because each term is even in 2. 


1 1 
ee ee ee 
y=1 at be 


y = cosx 


1 
2 
a” + 


YS 


Put po(x) = 1 — (x7/2) and pa(x) = 1 — (27/2) + (x4/24). Clearly 
p2(x) > 0 for 0 < x < V2, and by the quadratic formula, p(x) > 0 for 
0<a< V6— 12. The preceding inequality for cos implies 


cos(/6 — V12) <0 < cos V2. 


The intermediate value theorem guarantees that cos has a zero between 


V2 = 1.41421 and /6—/12 & 1.59245. This is the unique zero 
in [0, 6], because 


3 
cos! x = —sine <—2 +> <0 for 0 <2 < V6. 


Evenness of cos implies 0 < cosx for -a <2 <a. 


Proposition 11.8. [fa > 0 is the smallest positive root of cos, then 


cos(z + 4a) = cosa, sin(a +4a)=sinz, for all real x. 
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Definition 11.9. The smallest positive period of the cosine function 
is called 27; that is, 7 = 2a. 


Remark 11.10. The number 7 is the familiar ratio of the circumference 
of a circle to its diameter, see below. Proposition 11.7 guarantees that 


2.82842 <7 < 3.1849. 


Figure 11.1: The smallest positive zero of the cosine function. 


Proof. Since cos(m7/2) = 0, we have sin(a/2) = +1. The proof of 

Proposition 11.7 guarantees that 0 < x — 73/6 < sinz forO<a2< V6, 

so we have sin(a/2) = 1. The addition formulas for sin and cos give 
sin(x + 7/2) = sinxcos(7/2) +cosaxsin(a/2) = cosa, 


cos(x + 1/2) = cosxcos(7/2) — sina sin(7/2) = —sina. 


Bootstrapping, we have sin(a +7) = cos(a+ 7/2) = —sinz, and there- 
fore sin(a+27) = —sin(x+7) = sin for all real x. The cosine function 
is 27-periodic as well since cos x = sin(a# + 7/2) for all a. 


Remark 11.11. The proof shows sin and cos are 7-anti-periodic, in the 
sense that 


sin(x +7) = —sing, cos(a +7) =—cosz for all real z. 


Consequently, sin x = 0 if and only if « = ka for some integer k, while 
cos z = 0 if and only if « = (k + $)7 for some integer k. 


Theorem 11.12. For all real x, cosx = sin(a/2 — x). Further, 
sin(1/4) = cos(/4) = V2/2, 
sin(7/6) = cos(7/3) = 1/2, 
cos(m/6) = sin(/3) = V3/2. 
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Proof. The identity cosx = sin(z/2 — x) follows from the addition 
formula for sin and evenness of cos. Taking « = 7/4 shows that 
cos(7/4) = sin(7/4); since each is positive and the sum of their squares 
is 1, each is equal to /1/2 = J2/2. 
Repeated use of the addition formulas gives, for all real x, 
cos 3x = cos(2x + x) = cos(2x) cos x — sin(2x) sin x 


(cos? x — sin? x) cos x — (2sinxcos x) sinz 


= cos z(cos”? x — 3sin? x) = cosx(1 — 4sin? 2). 

Let x = 7/6. Since cos3z = cos(m/2) = 0 but cosx > 0, we have 

1 = 4sin?x. But sinz > 0 since 0 < x < 1/2. We conclude that 
sin(7/6) = 1/2, and therefore that cos(7/3) = sin(7/6) = 1/2. 

IfO0<a2< 7/2, then cosx = V1 — sin? x since both cos and sin are 

non-negative on this interval. The preceding conclusions immediately 

imply cos(7/6) = sin(7/3) = V3/2. 


The Unit Circle 


Theorem 11.13. Let x and y be real numbers satisfying x? + y? = 1. 
There exists a unique real number 0, 0 < @ < 27, such that x = cos é 
and y = sin @. 

Proof. Since cos is continuous and strictly decreasing on [0,7], and 
cos0 = 1, cosa = —1, Theorem 8.33 implies cos maps [0,7] bijec- 
tively to [—1, 1]. A similar argument shows cos maps (7, 27) bijectively 
to (—1, 1). 

If a point (x, y) on the circle x?+y? = 1 lies in the closed upper half- 
plane, i.e., if0 < y < 1, then y = V1 — 2”. By the preceding paragraph 
there exists a unique @ in [0,7] with z = cos@. Since sin@ > 0 for 
0<60< 1, the point (cos @, sin @) is equal to (x,y). 

If instead (x,y) lies in the open lower half-plane, i-e., —1 < y < 0, 
then y = —V1— 2? and -1 < # < 1. There is a unique 6 in (7, 27) such 
that « = cos @. Since sin # < 0 for 7 < @ < 27, the point (cos 0, sin @) is 
equal to (x,y). 

In summary, the mapping 6 +> (cos 6,sin @) is a bijection from the 
half-open interval [0, 27) = [0, a] U (a, 27) to the unit circle. 


Remark 11.14. If a particle has position (cos @,sin@) for 0 < @ < 2z, 
the preceding argument shows that the particle traces the unit circle 
once. The particle’s speed at time 6 is \/(cos’ 0)? + (sin’ @)? = 1, so the 
distance traveled, a.k.a., the circumference of the unit circle, is 27. 
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11.2 Auxiliary Trig Functions 
Definition 11.15. On the set of real numbers x such that cosx ¥ 0, 
define the secant function seca = 1/ cos 2. 


Remark 11.16. The secant is even, 7-anti-periodic, and | sec z| > 1 for 
all x in the domain. 


Figure 11.2: The cosine and secant functions. (Tick marks are integers. ) 


Definition 11.17. On the set of real numbers x such that sinx ¥ 0, 
define the cosecant function cscx = 1/sin x. 


Remark 11.18. The cosecant function is odd, 7-anti-periodic, and sat- 
isfies the identity csc(# + 5) = seca. 


Definition 11.19. On the set of real numbers x such that cosx ¥ 0, 
define the tangent function, tan xz = sinx/cos«. 


Remark 11.20. The tangent function is odd, as a quotient of an odd 
function by an even function, and periodic with period 7: 
sin(a+a7) —sing 


t = = = tan z. 
See) cos(a+7)  —cosx 


Proposition 11.21. The tangent function is differentiable on the “pe- 
riod interval” (—1/2,7/2), satisfies tan'x = sec? x for all x in the 
domain, and maps the period interval bijectively to R. 

For all real x and y, 


tanz + tany 


t = : 
ane) 1—tanztany 


AMS Open Math Notes: Works in Progress; Reference # OMN:201801.110758; Last Revised: 2018-01-20 09:16:33 


226 CHAPTER 11. CIRCULAR FUNCTIONS 


Figure 11.3: The sine and cosecant functions. (Tick marks are integers. ) 


Figure 11.4: The tangent function. (Tick marks are integers.) 


Proof. The quotient rule gives 


cossin’—sincos’ cos? + sin? i 
! 2 
COs cos COs 


In particular, tan is strictly increasing (hence injective) on (—7/2, 7/2). 
Since cos and sin are positive on (0,7/2), tanz = sinx/cosx — oo 
as x — 7/27. Since tan is odd, tanz + —oo as x > —7/27. A 
standard Intermediate Value Theorem argument shows tan maps the 
period interval surjectively to R. 

For all real x and y, 


ere sin(a+y)  sinxcosy+cosxsiny tanxz + tany 
an(x = = = 
’ cos(a+y)  cosxcosy—sinaxsiny 1-—tanzxtany 
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the final equality follows by dividing the numerator and denominator 
by cos x cos y. 


Corollary 11.22. For every integer k, there exists a unique real num- 
ber « such that (k — 3)n <a <(k+4)m and tang =z. 


Proof. The function f(«) = tanz — x is differentiable, with derivative 
f'(x) = sec?.x —1> 0. Since the derivative vanishes at isolated points, 
namely at x = kz, f is strictly increasing on ((k — Sq, (k+ i\r). On 
this interval, x is bounded while tan approaches —oo at the left endpoint 
and approaches oo at the right endpoint. By the Intermediate Value 
Theorem, f maps ((k- 5), (k+3)m) bijectively to R, and in particular 
is equal to 0 exactly once in this interval. 


Definition 11.23. For x not an integer multiple of 7, define the cotan- 
gent function cot x = cos x/ sin x. 


Remark 11.24. The cotangent is periodic with period 7. Away from 
integer multiples of 7/2, tan = sin/cos and cot = cos/sin are recip- 


rocals, and cot(« + 4) = —tanz. The derivative of cot is —1/ csc’, so 
cot is decreasing on every interval of the form (kr, (k+ 1)r) with k an 
integer. 


11.3 Inverse Trig Functions 


Each circular function is periodic, hence has no “global” inverse. In- 
9 

stead, we restrict each function to an interval on which the function is 

injective, obtaining a branch of inverse. 


Inverse Sine and Cosine 


Definition 11.25. The restriction of sin to the interval [—1/2, 7/2] 
is denoted Sin. The inverse function Sin! : [-1,1] > [-7/2, 7/2], 
sometimes denoted arcsin, is called the principal branch of arcsin. 


Remark 11.26. By definition, 


sin(Sin-' x) =a for all x in [-1, 1], 


Sin! (sin y) = y for all y in [—7/2, 7/2]. 
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Figure 11.5: Sin. 


Figure 11.6: Sin7! 


Proposition 11.27. The function Sin™' is continuous on [—1,1], dif- 
ferentiable on (—1,1), and 


Ge —, Spe eet 


V1 — 2? 
Proof. By Theorem 8.27, Sin™' is differentiable since sin’ y = cosy 4 0 
for —17/2 < y < 1/2, and 
1 _ 1 ee 
cos(Sin“*z) 4/1 —sin?(Sinbx) 9 V1I—a2? 


(Sin')'(«) = 


Corollary 11.28. Fora > 0, la : 
2 = ~ 9 


Proof. For 0 <2 <a, 


ae 1 1 
2g? (a+ x)( (a— 2) = aaa) 


a 


and the upper bound is improperly integrable by Proposition 9.15. The 
smaller improper integral therefore converges. Factoring a? from the 
radicand and using the substitution u = x/a gives 


dx/a 1 dx 


By the second fundamental theorem, this is Sin7' 1 — Sin7' 0 = . 
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Definition 11.29. The restriction of cos to the interval [0,7] is de- 
noted Cos. The inverse function Cos~' : [-1,1] > [0,], sometimes 
denoted arccos, is called the principal branch of arccos. 


Remark 11.30. The identity cosy = x = sin(7/2 — y) for0O <y <a 
implies Cos”! « = y = (1/2) — Sin”! & for x in [—1, 1]. 
Inverse Tangent 


Definition 11.31. The inverse of tan on the interval (—7/2, 7/2) is 
the principal branch of arctan, denoted Tan™' : R + (—7/2,7/2). 


Remark 11.32. By definition, 


tan(Tan"'z)=2 for all real z, 
Tan ‘(tany) =y for all y in (—72/2, 7/2). 


Figure 11.7: The principal branch of arctan. 


Proposition 11.33. The function Tan~' is differentiable on R, and 


(Tan7")'(x) = for all real x. 


1 
1+2? 
Proof. Since tan’ x = sec? x > 0 for all real x, Theorem 8.27 guarantees 
that Tan™! is differentiable, and 


1 1 1 
(Tan~*)'(a) = =a 2 = pr ae a 
sec?(Tan- 2) 1+tan*(Tan 2) I1+2 
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mee) 
Corollary 11.34. For every a > 0, i aa = a 


Proof. The integrand is non-negative and bounded above by 1/27, so 
the improper integral converges by Proposition 9.15. If a = 1, the 
second fundamental theorem gives 


ioe) b 
d. 
Ae = Him f = im Tan b= Tan = 2 

9 l+a? boo Jy 1+2? boo 2 
If a £1, use the substitution u = x/a: 

[ dx at a-dx/a --[° du =o 

0 a+a2 0 a?[1 + (x/a)?| es 0 1+4u? 2a 
Corollary 11.35. For —1 < x < 1, Tan’'x may be expanded in a 
power series 


oo g2ktl fa 7? at 
Tan-'r= 5 (-1 =2->+ 5-34 
eae 2 ees ae ee a a 


Proof. The geometric series 


=S(-1 Le Se See 
k=0 


converges absolutely for all ¢t in (—1,1). Integrating term by term, 


k=0 k=0 
= 1 
ll 11.36. 7 =2 a 
Corollary 11.36. 7 va 2 ) 35k +1) 


Proof. By Theorem 11.12, tan(7/6) = sin(7/6)/cos(7/6) = 1/3, so 
x = 6Tan'(1//3). Setting x = 1/\/3 in the power series for Tan™! 
and noting that 2?*+1 = 1/(3*,/3) and 6/V/3 = 2V3, 


el aaa wD (-1 35k +1) cea 


k=0 
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Remark 11.37. This series alternates, so “the tail is bounded by the 
size of the first omitted term”, i.e., 


T Z 1 2 
—==2%). (=1)* = 
73 2 ) 38(2k +.1)| — 3°+1(2n + 3) 


For example, taking n = 10 (i.e., 11 terms) gives a rational estimate 
of r/V/3 that is accurate to within e = 2/4,074,382 < 0.5 x 10~°. 


11.4 Applications 


Theorem 11.38. Letn > 1 be an integer. For all real numbers a and b, 


b 1 a=b b 
ee jel = 
i cos*xdx = —cos”!azsing + / cos”? x dx, 
a n xr=a n a 
b 1 a=b b 
Lae n—1 ; 
i sin” x dx = —— sin” 'xcosz - / sin”? x dz, 
a n L~=a n a 
Proof. Integrating by parts with 
u=cos” ! gz, P=sin CUR; 
du = —(n — 1) cos” * gsinz dz, du = cos # a, 


and using sin? x = 1 — cos? x gives 


b z=b b 
| cos" x dx = cos" / xsin x +(n—-1) / cos” * x sin? x dz, 
a “=a a 
a=b b 
= cos”! xsin x +(n—1) / cos”? x dx 
xr=a a 


b 
-(n-1) f cos" x dx. 


Moving the last integral to the left-hand side and dividing by n gives 
the first formula. The second formula is left as an exercise. 


Corollary 11.39. [fn > 0 is an integer and 


m/2 a /2 
I(n) = cos” x dx =) sin” x dx, 
0 0 
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then 
(2k) = (2k—-1) (2k-3) 5 3 1 o Qk)! or 
Ce ee i re 
2 4 2 OF KIN? 
pis eee 
(2k +1) (2-1) 7 5 8 (2k +1)! 
Proof. Applying the theorem with a = 0 and b = 7/2, the boundary 


terms vanish, so 


—1 
“——.I(n-2), 100) ==, 
The “expanded” forms of the integrals follow immediately. To express 
these in terms of factorials, note that 


I(n) = 


10) =1. 


(2k)-(2k—2)...6-4-2 = 2*-kl, (2k—1)-(2k—3) ...5-3-1 = ——— 


Definition 11.40. The @ function is defined by 


1 
Bla,y) = i; t1(1-¢)" dt for z, y>0. 
0 


Etat 

Teta) for all xz, y > 0. 
T(¢+y) 
Proof. Direct calculation gives G(1,y) = 1/y for y > 0. Further, 
log G(-, y) is convex in the sense that if : - ; = 1, then 


Theorem 11.41. 6(z,y) = 


B(2 + 2,4) < Bla, y)"?B(z,y)"/* for all x, y, z > 0. 
The proof is entirely similar to log convexity of T. Finally, 
1 
Biet+l1y)= i: CUS e hae. 
0 


Integrating by parts, using u = ¢” and dv = (1 — t)¥~1 dt, gives 


t=] x 7 
4} = | PL 9)" de. 
t=0 Y Jo 


The boundary term is zero, and since 


Bet ae —=( _ 4)! 


71 —f¥ =e 101-48)" 101-48) 
Sf at Fa 
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the integral is equal to 


; [fea Se aa a [eo — ora - lds y)—B(e+1,y)]. 


Rearranging, 6(z+1,y) = ay Ply). Putting these pieces together, 
the function 


(e+ y) 
a) = ey 
(2) = “EP ote 
satisfies properties (a)—(c) of Theorem 10.32, so f =T. 
a /2 r r 
Corollary 11.42. 2 | (sin 0)°*~'(cos 0)7¥~! dO = aeHOy 
0 T(x +y) 
Proof. Substitute t = sin? @ in the definition of (. 
+00 
Corollary 11.43. i e du= Vn. 
Proof. Taking x = y = 1/2 in Corollary 11.42, 
= Me = ay er eee ae ee ee 
T= 2 dé = , or Yx=T()= fo eas 
0 I(1) 0 


The substitution u = Vt, du = dt / 2\/t transforms the last integral into 


| ee du = vn 
0 2 


Since the integrand is even, the claim follows. 


Remark 11.44. Taking x = 1/2 or y = 1/2 expresses the integrals of 
powers of sin and cos in terms of I, compare Corollary 11.39. 


The Sine Integral 


An extended example will demonstrate a variety of techniques devel- 
oped so far. 


Example 11.45. If « 4 0, then 
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The radius of convergence is oo, just as for the sine series, so we may 
view s as a real-analytic function on R satisfying s(0) = 1. 
The sine integral function is defined by 


sintdt — Legere a - 
SI as — — — 
(7) {= 2 rea \OQkEI Beal Beal 


The critical points of SI are the zeros of s, namely the non-zero 
integer multiples of 7. The critical values are, for each n > 0, 


SI(( ((n ah =f sin - = fie ie pee 
kr k—0 kr 


The quotient rule gives 


xcos x — sin x 


Sasa) = ee 00 


ie 
The derivative s’(0) may be evaluated using the calculus of sloppiness: 
cosx © 1+ O(2?) and sing ~ x + O(2?) for x = 0, so 


r—x+O(z2?) 


2 


8 (2) = 


> = O(x) > 0. 
The critical points of s are solutions of xcosx — sinx = 0. At each 
critical point, cosx # 0, since sina = +1 when cosx = 0. Conse- 
quently, s’(a2) = 0 if and only if = tanz. By Corollary 11.22, there is 
exactly one critical point of s in each interval (k — +) <“<(k+ $)q. 
The function s “oscillates”, but the size of the oscillations decreases 
with |¢|. Precisely, 


int 
s(t{+ 27) = = < s(t) for allt > 0. 
T 
Since 
| sin ¢| |sint| _ |sin¢| 
< forkr <t<(k+1)z, 
(k4+1)n7~ t ~— ko ani Soe Mert yh 
we have 
ao si SE i lal Se for k > 0. 
(A+1)a i L kr 
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The signs of the integrals a, alternate, since sin is alternately positive 
and negative between integer multiples of 7, and |ax41| < |ax| for all 
k > 0. The absolute maximum value of SI is therefore the first critical 


value eee 
SI(x) = i eee, 
ae Ot 


By the alternating series test, lim (SI(nz), 00) exists, and since the par- 
tial sums bound the partial integrals, the improper integral 


lim SI(x) = | eed 
0 


Lo b 


converges. However, the integral is not absolutely convergent, since 


(k-+1)m 
Peder 


is (a multiple of) the harmonic series. 


sint sint 


Exercises 
Exercise 11.1. Use termwise differentiation to give an alternative 
proof that sin’ = cos and cos’ = — sin. 
Exercise 11.2. Use the trigonometric power series to evaluate: 
2 
1— *1-— cost 
@)lim==— = (b) lim | ———** at. 
x0 x x0 0 8 


Exercise 11.3. Prove that sec’ = sec - tan (including that the domains 
are the same). 


Exercise 11.4. Prove that cot2« = $(cota — tan) if x is not an 
integer multiple of 7/2. 


Exercise 11.5. Evaluate sin and cos | exactly. (Your answers should 


involve only square roots and rational numbers.) 


Exercise 11.6. Let 0 < x < 1, and let 0 = Sin‘ z: 
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It follows immediately that cos? = /1— x?, 


Me V1l— 2? 
sec 9 = ———,,_ tan? = ———.,,_ cot 9 = ———_.. 
V1 — x? 1-2 £ 
Similarly, find cos Tan™! x, sec Tan7! x, and sin Tan™! z. 


Exercise 11.7. Use the substitution u = x — (1/x) to evaluate the 


improper integral 
| °F? +1 q 
hoe 
9 wzt+1 


Exercise 11.8. This exercise outlines an evaluation of the improper 


integral 
‘i log sin x dx. 
0 


(a) Show the improper integral converges. 
Suggestion: Split the interval at 7/2 and use symmetry to deduce 
the two integrals are equal. To prove that each converges, first show 
that'2/2 <sing'<% for 0 < o< 7/2: 


(b) Use the substitution 2 = 2u and the double angle formula for sin 2u 
to obtain an algebraic equation for the integral, and solve. 


Exercise 11.9. Prove that the Fresnel integrals 
| cos(x”)dz and | sin(a2) dx 
0 0 


converge conditionally. (Do not attempt to evaluate.) 
Exercise 11.10. Show that the power series 
We te. 


fe)= Yap =) a Pay CG 


k=0 


(oe) 


has infinite radius, and f(x?) = cosx and f(—2x?) = cosh for x > 0. 


Exercise 11.11. Using the Lagrange form of the remainder, how large 


could 
n 2k 


cos x — Sy o(-1' Oh)! 


k=0 


be if |a| < a/2 < 1.6? How many terms are sufficient to estimate cos x 
on this interval to within « < 0.5 x 107°? e < 0.5 x 107%? 
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Exercise 11.12. By continuing the estimates in the proof of Proposi- 
tion 11.7, prove inductively that for all n > 0 and all real x > 0, 


2n+1 ‘ 2k 2n Z gk 
(—1) <cosxz < (—1) : 
cr aa 
ant] 2k+1 2m 2k+1 
x x 
_ < sina < —l 
2 ) (Qk+ ayy - »| (2k + 1)! 


In words, the Taylor polynomials for cos and sin alternately under- 
estimate and over-estimate the function values on the positive reals. 
(The fact that the coefficients alternate in sign is not enough to deduce 
this result, but 7s a good way of remembering it.) 


The following multi-part exercise presents Ivan Niven’s proof that 7? 
is irrational. It follows that 7 itself is irrational. 


Exercise 11.13. Define f,, : [0,1] > R by 


g(a)" 
n! 


fn(@) = 
Prove each of the following assertions. 
(a) If0<a <1, then0 < f,(2) < 5. 
(b) The derivatives £0) and fOM are integers for all k > 0. 


Assume 1? = p/q in lowest terms, and let 


=4q 3G 1)* £2") (¢ en 2k 


(c) F,(0) and F,,(1) are integers. 


oe (FY (x) sin ra — 1F,,(x) cos 72). 


(d) mp" f,,(x) sin tx = re 


(e) F,(1) + F,(0) = no" | fr(x) sin wx da. 


(f) If n is sufficiently large, then 0 < F,,(0) + F,(1) < 1. 


In short, if 7? is rational, there exists an integer between 0 and 1. 
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Index 


Absolutely convergent 

integral, 185 

power series, 93 

series, 72—75 
Algebraic real number, 89 
Alternating series, 75 
Anti-periodic function, 101 ez. 
Antiderivative, 160 
Approximately equal to, 34, 54, 

112-113 

over an interval, 114, 149 
Archimedean property, 44 
Average value, 151 ez. 

weighted, 154 ez. 


Bijective function, 85 

Boundary point, 46 

Bounded function, 119 
integral of, 130 


Cantor diagonal argument, 89 
Cantor set, 39-40, 48-49, 102 ez., 
Loen; 
approximations to, 39 
ternary representation, 78 ez. 
uncountability of, 90 
Cauchy sequence, see Sequence 
Chain rule, 163 
Characteristic function, 81, 97 ez. 
Closed set, 47 


Cocycle condition, see Integral 
Composable functions, 83 
Continuous function, viii, 103 
definite integral as, 145 
graph of, 105-106 
integrability of, 142-143 
local boundedness, 108 
and monotonicity, 109 
power series as, 114 
preimage of open set, 126 ez. 
Continuously differentiable, 160 
is difference of monotone 
functions, 195 ex. 
Contraction mapping theorem, 
125 ez. 
Convex function, 168 
as definite integral, 173 ez. 
log I’, 209 
and sign of second derivative, 
169, 181 
Countable set, 87-89 


Darboux’s theorem, 174 ez. 
Derivative, 155 
continuity of, 173, 174 ex. 
of exponential function, 198, 
199 
linearity of, 160 
of monomial, 162 
of inverse function, 164-165 
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of polynomial, 162 

of power function, 199 

of product and quotient, 161 
Dirichlet function, 81 

non-integrability of, 133 
Discrete dynamical system, 122 
Double angle formula 

for cotangent, 235 ez. 

for sine and cosine, 220 


e, 147 

irrationality of, 202, 215 ez. 

numerical estimate, 203 

transcendentality of, 216 ez. 
e-d game, 106-111 
e-N game, 55-57 
Even function, 82 

integral of, 141 

and power series, 116 
Exponential function, 198 

as limit of geometric growth, 

200 

Exponentiation, 199 

integer power, 20-23 

bounds on, 23 

rational power, 118-119 

real power, 199-200 
Extended real number, 44, 120 
Exterior point, 46 
Extreme value theorem, 119-120 


Factorial, 23-24, see also 
I function 
bounds on, 206-208 
Fixed point, 122 
Fundamental Theorem of 
Calculus, xi, 177, 195 ez. 


I function, 208-210 
special values of, 233 
Geometric series, 70-71, 91-93 
and integral of power 
function, 133 
Greater than, 15 
Greatest lower bound, see 
Infimum 


Harmonic series, 71 

Heaviside function, 127 ez. 

Holder’s inequality, 209, 214 ez. 

VHopital’s rule, 175 

Horner’s form, see Polynomial 

Hyperbolic functions, 203-205 
inverse, 205-206 


Identity theorem 
for differentiable functions, 
166 
for power series, 115 
Improper integral, 151 ez., 
183-187 
change of variables in, 186 
and summability, 187 
Increasing function, 86 
Indeterminate limit, xi 
Inequalities, 18-20 
Infimum, 42 
of a function, 119-120, 130, 
136-139, 143 
Infinite limits, 120-121 
Infinite series, 69-76 
absolutely convergent, 72—75 
alternating series test, 75 
divergent, 69 
geometric, 70-71 
integral test, 187 
estimates for, 195 ez. 
ratio test, 74-75 
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Infinity, see Extended real 
number 
Inflection point, 168 
Injective function, 84 
Integral, 131 
change of variables, 140, 178, 
186 
cocycle condition, 136, 140, 
145 
of a continuous function, 148 
of the Dirichlet function, 133 
of a monotone function, 142 
and partitions, 132 
of a power function, 133-135, 
146 
of a power series, 149-150 
of a product, 148, 178 
properties of, 135 
Integration by parts, 178 
Interior point, 46 
Intermediate value theorem, 
117-119 
and existence of square roots, 
86, 118 
Intersection of sets, 37 
Interval, 33-36 
of convergence, 91 
Inverse function, 84 
branches of, 167 
derivative of, 164-165 
exponential function as, 198 
hyperbolic, 205-206 
trigonometric, 227-231 
Irrational numbers, 15, 29 
Isolated point, 46 


Lagrange interpolation 
polynomials, 99 ex. 
Largest element, 26-27, 41 
geometric interpretation, 33 


Law of exponents 
integer power, 21 
real power, 199, 200 
Least upper bound, see 
Supremum 
Leibniz notation, xi, 159, 172 ez., 
177, 179 
Less than, 15 
Limit 
of a function, 106-111 
one-sided, 110-111 
of a sequence, v, 54-57, 
60-65, 67 
Limit point, 46 
Linear approximation, 157 
Linearity 
of the derivative, 160 
of the integral, 135 
Local extremum, 156-157 
Logarithm, 147, 197-198, 200 
graph of, 198 
series representation of, 150 
Lower bound, 40 


Mean Value Theorem, 165-166 
Midpoint sum, 153 ez. 
Monotone function, 86 
definite integral as, 145 
discontinuous on rationals, 
Leer: 
effect on inequality, 86 
integrability of, 142 
one-sided limit of, 111 
and sign of derivative, 166 
Monotonocity of the integral, 
135, 139 
De Morgan’s laws, 3 
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Natural domain, 80 
Natural logarithm, see 
Logarithm 
Negative part 
of a function, 82 
of a sequence, 73 
Newton’s binomial theorem, 
193 ex. 
Newton’s method for square 
roots, 123 
Non-decreasing function, 86 


Odd function, 82 

integral of, 141 

and power series, 116 
One-sided limit, 110-111 

of monotone function, 111 
Open set, 47 

preimage under a continuous 

function, 126 ez. 


Partition, 129 
integrability criterion for, 132 
refinement of, 130-131 
Peak point, see Sequence 
Periodic function, 83 
integral of, 194 ez. 
T, 223 
irrationality of, 237 ez. 
Piecewise function, 81 
Pizza, number of pieces, 28 
Polynomial 
continuity of, 104 
derivative of, 162 
Horner’s form of, 80 
integral of, 147 
Polynomial division, 98 ez. 
Polynomial function, 80 
Positive part 
of a function, 82 


of a sequence, 73 

Power series, x, 91-95, 114-116 
absolutely convergent, 93 
coefficients of, 91 
differentiation of, 182-183 
identity theorem, 115 
interval of convergence, 91, 93 
operations on, 91, 92 

Power set, 10 


Ratio test, 74-75 
for power series, 94-95 
Rational function, 80 
continuity of, 104 
Rational numbers, 15, 28-31 
density of, 49-50 
Real numbers, 13-15 
algebraic properties, 16-18 
completeness axiom, 41-43 
number line, 27 
order properties, 18-20 
Real-analytic function, 92 
Recursive sequence, 122 
Relatively open set, 126 ex. 
Reverse triangle inequality, 25 
Riemann sums, 151 ez. 


Sequence 
absolutely summable, 72-75 
algebraic properties of limits, 
60-62 
bounded, 58 
Cauchy, 67-68, 125 ex. 
divergent to oo, 63-65 
e-N game, 55-57 
limit of, v, 54 
monotone, 58-60 
partial sums of, 69 
peak point, 66 
of powers of x, 57, 63 
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recursive, 122 

summable, 69 

tail of, 66 

terms of, 53 

uniqueness of limit, 54 
Set 

bounded, 40 

complement of, 9 

empty, 8 

infimum, 42 

intersection, 37 

scaling, 37 

subsets of, see Power set 

supremum, 42 

translation, 37 

union, 37 
Sets 

difference of, 9 

disjoint, 10 

equality of, 8 

intersection of, 9 

subsets of, 8 

union of, 9 
Signum function 

integral of, 144-145, 151 ez. 
Simpson’s rule, 153 ez. 
Smallest element, 26-27, 41 

geometric interpretation, 33 
Smooth function, 160 
Square root, vi 

derivative of, 156 

existence of, 118 


irrationality of, vii 

numerical estimation of, 123 
Squeeze theorem 

for sequences, 76 ez. 
Step function, 82, 97 ez. 
Stereographic projection, 98 ez. 
Stirling’s formula, 206 
Subsequence, 65-68 

monotone, 67 
Supremum, vii, 42 

of a function, 119-120, 130, 

136-139, 143 

Surjective function, 85 


Tangent line, 105, 158-159, 
DViS-€2: 
Taylor’s theorem, 179 
Transcendental real number, 89 
Trapezoid sum, 153 ez. 
Triangle inequality, 24-26 
for integrals, 135 


Uncountable set, 89 
Uniform continuity, 142 
Union of sets, 37 
Upper bound, 40 


Yogi Berra, 28 


Zooming in 
on a continuous function, 105 
on a differentiable function, 
158 
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